00000001:02000400:1.0F:1788535636.786040:0:3316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788535657.225878:0:3538:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788535658.969257:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 847 MB/s 00000001:01000000:3.0F:1788535659.220640:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 749 MB/s 00000001:01000000:2.0:1788535659.470334:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4475 MB/s 00000020:02000000:2.0:1788535660.387494:0:3630:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_gb2d482c 00000400:02000000:1.0:1788535661.560323:0:3644:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.113@tcp [8/256/0/180] 00008000:02000000:3.0:1788535664.965566:0:3793:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788535726.387017:0:5761:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788535739.447626:0:6511:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788535739.447632:0:6511:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788535739.447633:0:6511:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788535739.447761:0:6511:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000bedc66c 00000080:02000400:2.0:1788535739.447772:0:6511:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788535739.454616:0:6511:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788535739.454629:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788535739.454656:0:6511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002e3a21fb) 00000020:00000080:2.0:1788535739.454674:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788535739.517704:0:6511:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788535739.518515:0:6511:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788535739.559633:0:6511:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788535739.559878:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788535739.559886:0:6511:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788535739.559898:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdbf4f 00000020:01000004:0.0:1788535739.559904:0:6511:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788535739.559909:0:6511:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788535739.559913:0:6511:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000bedc66c from MGS 00000020:01000004:0.0:1788535739.559917:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788535739.559935:0:6511:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f961f4c0) 00000020:00000080:0.0:1788535739.559946:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788535739.560054:0:6511:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000bedc66c from MGS, refs=2 00080000:01000000:0.0:1788535739.560060:0:6511:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788535739.560065:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdbf5d 00000100:00100000:0.0:1788535739.560331:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788535739.560474:0:6511:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788535739.560480:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788535739.560782:0:6511:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788535739.560788:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788535739.567503:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788535739.567683:0:6511:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788535739.567689:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788535739.572850:0:6511:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788535739.572865:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788535739.574552:0:6511:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788535739.574567:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788535739.575747:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535739.575752:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535739.575754:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535739.576980:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535739.576984:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535739.576986:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535739.577920:0:6511:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788535739.580409:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788535739.827182:0:6511:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4679 MB/s 00000001:01000000:3.0:1788535740.077313:0:6511:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6655 MB/s 00000001:01000000:1.0:1788535740.330297:0:6511:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 624 MB/s 00000001:01000000:0.0:1788535740.581487:0:6511:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 752 MB/s 00010000:00010000:1.0:1788535740.588655:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788535740.596186:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1788535740.603658:0:6511:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788535740.604358:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788535740.604507:0:6511:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788535740.604541:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788535740.604676:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788535740.604697:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788535740.605021:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788535740.605328:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788535740.605335:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788535740.608055:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788535740.608783:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788535740.609300:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788535740.609308:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788535740.612863:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788535740.612885:0:6511:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:1.0:1788535740.612887:0:6511:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788535740.612930:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:1.0:1788535740.612953:0:6511:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (0000000057f61171) 00000020:00000080:1.0:1788535740.612970:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788535740.613068:0:6511:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006ba641f4@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788535740.613251:0:6511:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:1.0:1788535740.613258:0:6511:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788535740.613586:0:6530:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788535740.618442:0:6531:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788535740.618529:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid 89006101-b582-4041-a87b-c8866dc8e13c) 00000020:00000080:2.0:1788535740.618555:0:6511:0:(genops.c:1385:class_connect()) connect: client 89006101-b582-4041-a87b-c8866dc8e13c, cookie 0xe79af2f39bbdbf6b 00000100:00080000:2.0:1788535740.618569:0:6511:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788535740.618574:0:6511:0:(import.c:665:import_select_connection()) MGC192.168.203.113@tcp: import 000000006ba641f4 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788535740.618622:0:6511:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cfd3b390 x1875415569268864/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788535740.618639:0:6511:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 89006101-b582-4041-a87b-c8866dc8e13c->MGS 00000020:01000004:2.0:1788535740.618665:0:6511:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788535740.618670:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788535740.618682:0:6511:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000078de7e0b) 00000020:00000080:2.0:1788535740.618693:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788535740.622990:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cfd3b390 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89006101-b582-4041-a87b-c8866dc8e13c:3659:1875415569268864:0@lo:250: 00000100:00100000:3.0:1788535740.623100:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535740.625344:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569268864 00000100:00100000:1.0:1788535740.625365:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569268864 00000100:00100000:1.0:1788535740.625402:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535740.625408:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5a98775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3659:x1875415569268864:12345-0@lo:250: 00010000:00080000:1.0:1788535740.625433:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 89006101-b582-4041-a87b-c8866dc8e13c@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788535740.625460:0:6526:0:(genops.c:1385:class_connect()) connect: client 89006101-b582-4041-a87b-c8866dc8e13c, cookie 0xe79af2f39bbdbf79 00000100:00080000:1.0:1788535740.625580:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000d5ce34cf : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535740.625673:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5a98775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+5:3659:x1875415569268864:12345-0@lo:250: Request processed in 264us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535740.625681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535740.628551:0:3659:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788535740.628566:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:3.0:1788535740.628574:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788535740.628579:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788535740.628583:0:3659:0:(import.c:65:import_set_state_nolock()) 000000006ba641f4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788535740.628587:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788535740.628598:0:3659:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788535740.628605:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cfd3b390 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89006101-b582-4041-a87b-c8866dc8e13c:3659:1875415569268864:0@lo:250: 00000100:00100000:2.0:1788535740.645919:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788535740.646177:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788535740.646184:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788535740.646996:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788535740.647005:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788535740.647523:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788535740.647540:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788535740.648418:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788535740.648693:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788535740.648699:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788535740.649491:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788535740.649500:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788535740.728790:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788535740.728987:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788535740.728993:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788535740.730024:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788535740.730034:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788535740.730672:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535740.730839:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788535740.730845:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788535740.743465:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788535740.743562:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788535740.744768:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535740.744994:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788535740.745000:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788535740.745887:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788535740.745896:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788535740.746794:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535740.746948:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788535740.746953:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788535740.747808:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788535740.747818:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788535740.781540:0:6511:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535740.781771:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788535740.781778:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788535740.788446:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788535740.791557:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788535740.796957:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788535740.796974:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788535740.803476:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788535740.803515:0:6511:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788535740.803522:0:6511:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788535740.803621:0:6511:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788535740.803659:0:6511:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788535740.803663:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788535740.803665:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788535740.803666:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535740.803667:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535740.803668:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535740.803669:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535740.803671:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788535740.803672:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788535740.803673:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535740.803674:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535740.803676:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535740.803677:0:6511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788535740.803679:0:6511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788535740.803682:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788535740.803683:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788535740.803684:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535740.803685:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535740.803686:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535740.803687:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535740.803688:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788535740.803689:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788535740.803689:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535740.803690:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535740.803691:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535740.803692:0:6511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788535740.803717:0:6511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788535740.803736:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000703a78a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569268992:0@lo:253: 00000100:00100000:2.0:1788535740.803813:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535740.803910:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c99ff0f going to sleep for 11 seconds 00000100:00100000:1.0:1788535740.809406:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569268992 00000100:00100000:1.0:1788535740.809421:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569268992 00000100:00100000:1.0:1788535740.809485:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535740.809494:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007321abc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+5:6511:x1875415569268992:12345-0@lo:253: 20000000:01000000:1.0:1788535740.809564:0:6529:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788535740.809567:0:6529:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788535740.814443:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788535740.814630:0:6529:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788535740.814971:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788535740.818803:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788535740.821608:0:6529:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788535740.821616:0:6529:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788535740.821623:0:6529:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788535740.821625:0:6529:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788535740.821638:0:6529:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788535740.821838:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535740.822004:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788535740.822025:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788535740.822074:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788535740.822104:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788535740.822125:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788535740.822518:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788535740.822530:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788535740.822544:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788535740.822558:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788535740.822571:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788535740.822577:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788535740.822590:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788535740.822608:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788535740.822639:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788535740.822644:0:6529:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788535740.822651:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535740.822746:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788535740.822756:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788535740.822773:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788535740.822787:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788535740.822802:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788535740.822812:0:6529:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788535740.822838:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788535740.822846:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788535740.822859:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788535740.822874:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788535740.822890:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788535740.822898:0:6529:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788535740.822920:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788535740.822928:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788535740.822940:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788535740.822958:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788535740.823009:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788535740.823037:0:6529:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788535740.823123:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788535740.824555:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788535740.832299:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788535740.832331:0:6529:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:1.0:1788535740.832334:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1788535740.832347:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788535740.832352:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788535740.832382:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788535740.832393:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1788535740.832403:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788535740.832409:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788535740.832419:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788535740.832431:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788535740.832456:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788535740.832459:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788535740.832463:0:6529:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788535740.832504:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788535740.832506:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788535740.833415:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788535740.834325:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788535740.834351:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788535740.834363:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1788535740.834372:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788535740.834374:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788535740.834701:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788535740.834838:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788535740.834854:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788535740.834865:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788535740.834873:0:6529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788535740.834875:0:6529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788535740.834879:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788535740.834886:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788535740.834891:0:6529:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788535740.834898:0:6529:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788535740.835346:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788535740.835438:0:6529:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788535740.842750:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788535740.842785:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788535740.842798:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788535740.842815:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788535740.842835:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842850:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842859:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842865:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842871:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842876:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842882:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046b200fa already unused, calling callback (000000003d13c388) 00010000:00010000:3.0:1788535740.842886:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842911:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842925:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842932:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.842938:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788535740.842954:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788535740.864550:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007321abc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+5:6511:x1875415569268992:12345-0@lo:253: Request processed in 55049us (60730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535740.864568:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788535740.864679:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000703a78a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569268992:0@lo:253: 10000000:01000000:2.0:1788535740.864693:0:6511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788535740.864697:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788535740.864699:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788535740.864700:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535740.864700:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788535740.864701:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535740.864703:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535740.864704:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788535740.864705:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788535740.864706:0:6511:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788535740.864707:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535740.864709:0:6511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788535740.864728:0:6511:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000bedc66c from lustre-MDT0000 10000000:01000000:2.0:1788535740.864759:0:6511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788535740.864762:0:6511:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788535740.864765:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9005baf299c0 10000000:01000000:2.0:1788535740.864769:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788535740.864776:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9005baf299c0 from 1 10000000:01000000:2.0:1788535740.864779:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788535740.864813:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535740.864824:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535740.864832:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535740.864849:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000703a78a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269120:0@lo:101: 00000100:00100000:2.0:1788535740.864895:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535740.864950:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069cbac5f going to sleep for 11 seconds 00000100:00100000:3.0:1788535740.865024:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569269120 00000100:00100000:3.0:1788535740.865031:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569269120 00000100:00100000:3.0:1788535740.865101:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535740.865109:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b139617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+5:6511:x1875415569269120:12345-0@lo:101: 00010000:00010000:3.0:1788535740.865120:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535740.865131:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdbf87 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.865186:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdbf87 expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.865374:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdbf87 expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.865385:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046b200fa, rc 0) 00000100:00100000:0.0:1788535740.865479:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b139617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+6:6511:x1875415569269120:12345-0@lo:101: Request processed in 371us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535740.865486:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535740.866373:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000703a78a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269120:0@lo:101: 00010000:00010000:3.0:1788535740.866400:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.866410:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535740.866489:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269248:0@lo:501: 00000100:00100000:3.0:1788535740.866527:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535740.866554:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000006bf29126 going to sleep for 11 seconds 00000100:00100000:0.0:1788535740.866617:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569269248 00000100:00100000:0.0:1788535740.866622:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569269248 00000100:00100000:0.0:1788535740.866665:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788535740.866672:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007aecceac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+6:6511:x1875415569269248:12345-0@lo:501: 00000100:00100000:0.0:1788535740.866752:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007aecceac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+6:6511:x1875415569269248:12345-0@lo:501: Request processed in 80us (225us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788535740.866759:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788535740.866853:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269248:0@lo:501: 10000000:01000000:3.0:1788535740.866879:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788535740.866898:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.866907:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535740.866915:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9005831fb800 10000000:01000000:3.0:1788535740.866921:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788535740.866925:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9005831fb800 10000000:01000000:3.0:1788535740.866928:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788535740.866930:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9005831fb800 from 1 10000000:01000000:3.0:1788535740.866933:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788535740.866952:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000012f527d4/0xe79af2f39bbdbf95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.866959:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000012f527d4/0xe79af2f39bbdbf95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.866977:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000012f527d4/0xe79af2f39bbdbf95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535740.866989:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269376:0@lo:101: 00000100:00100000:3.0:1788535740.867014:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535740.867036:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000006bf29126 going to sleep for 11 seconds 00000100:00100000:2.0:1788535740.867081:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569269376 00000100:00100000:2.0:1788535740.867095:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569269376 00000100:00100000:2.0:1788535740.867127:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788535740.867133:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbd36a05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+6:6511:x1875415569269376:12345-0@lo:101: 00010000:00010000:2.0:1788535740.867141:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535740.867176:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e01a9b8/0xe79af2f39bbdbf9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdbf95 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535740.867191:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e01a9b8/0xe79af2f39bbdbf9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdbf95 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535740.867211:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e01a9b8/0xe79af2f39bbdbf9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdbf95 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535740.867219:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e01a9b8, rc 0) 00000100:00100000:2.0:1788535740.867248:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbd36a05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+7:6511:x1875415569269376:12345-0@lo:101: Request processed in 116us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535740.867255:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788535740.867377:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269376:0@lo:101: 00010000:00010000:3.0:1788535740.867387:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000012f527d4/0xe79af2f39bbdbf95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.867394:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000012f527d4/0xe79af2f39bbdbf95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535740.867404:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788535740.867407:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000012f527d4/0xe79af2f39bbdbf95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.867412:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000012f527d4/0xe79af2f39bbdbf95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535740.867417:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788535740.867421:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788535740.867425:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9005831fb800 10000000:01000000:3.0:1788535740.867427:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788535740.867429:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788535740.867431:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788535740.867444:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.867456:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.867462:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535740.867473:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269504:0@lo:101: 00000100:00100000:3.0:1788535740.867496:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535740.867524:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000006bf29126 going to sleep for 11 seconds 00000100:00100000:2.0:1788535740.867563:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569269504 00000100:00100000:2.0:1788535740.868216:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569269504 00000100:00100000:2.0:1788535740.868256:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535740.868262:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069e1ae32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+7:6511:x1875415569269504:12345-0@lo:101: 00010000:00010000:2.0:1788535740.868271:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535740.868278:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdbfa3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535740.868293:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdbfa3 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535740.868307:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdbfa3 expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535740.868313:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d71a1fcc, rc 0) 00000100:00100000:2.0:1788535740.868346:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069e1ae32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+8:6511:x1875415569269504:12345-0@lo:101: Request processed in 85us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535740.868352:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788535740.868470:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269504:0@lo:101: 00010000:00010000:3.0:1788535740.868484:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535740.868491:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535740.868545:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269632:0@lo:501: 00000100:00100000:3.0:1788535740.868570:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535740.868602:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000006bf29126 going to sleep for 11 seconds 00000100:00100000:2.0:1788535740.869380:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569269632 00000100:00100000:2.0:1788535740.869387:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569269632 00000100:00100000:2.0:1788535740.869418:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788535740.869425:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1933511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+8:6511:x1875415569269632:12345-0@lo:501: 00000100:00100000:2.0:1788535740.869552:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1933511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+9:6511:x1875415569269632:12345-0@lo:501: Request processed in 128us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535740.869558:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788535740.869674:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269632:0@lo:501: 00000100:00100000:3.0:1788535740.869707:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269760:0@lo:503: 00000100:00100000:3.0:1788535740.869749:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535740.869781:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000006bf29126 going to sleep for 11 seconds 00000100:00100000:2.0:1788535740.870245:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569269760 00000100:00100000:2.0:1788535740.870251:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569269760 00000100:00100000:2.0:1788535740.870287:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788535740.870295:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093918f85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+9:6511:x1875415569269760:12345-0@lo:503: 00000100:00100000:2.0:1788535740.870381:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093918f85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+9:6511:x1875415569269760:12345-0@lo:503: Request processed in 87us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535740.870388:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788535740.870521:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1916a74 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569269760:0@lo:503: 00000100:00100000:0.0:1788535740.873187:0:6555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004cb501a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:6555:1875415569269888:0@lo:502: 00000100:00100000:0.0:1788535740.873291:0:6555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535740.873333:0:6555:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082fd21fa going to sleep for 11 seconds 00000100:00100000:2.0:1788535740.873666:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569269888 00000100:00100000:2.0:1788535740.873674:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569269888 00000100:00100000:2.0:1788535740.873721:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788535740.873729:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085b24b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+9:6555:x1875415569269888:12345-0@lo:502: 00000100:00100000:2.0:1788535740.873846:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085b24b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+9:6555:x1875415569269888:12345-0@lo:502: Request processed in 118us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535740.873859:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788535740.874607:0:6555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004cb501a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:6555:1875415569269888:0@lo:502: 00000020:01000000:0.0:1788535740.874653:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535740.874671:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535740.874674:0:6555:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788535740.874679:0:6555:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788535740.874681:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788535740.874695:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bc4327f0) 00000020:00000080:0.0:1788535740.874711:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788535740.874716:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788535740.874805:0:6555:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788535740.874813:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdbfb8 00000020:00000080:0.0:1788535740.875059:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788535740.875063:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535740.875067:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535740.875068:0:6555:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788535740.875070:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535740.875074:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535740.875075:0:6555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788535740.875078:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788535740.875094:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e5489430) 00000020:00000080:0.0:1788535740.875104:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788535740.875109:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788535740.875110:0:6555:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788535740.875113:0:6555:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788535740.875118:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788535740.875455:0:6555:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000bedc66c from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788535740.875469:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000a5a7d9d) 00000020:00000080:0.0:1788535740.875477:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788535740.875550:0:6555:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788535740.875556:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdbfcd 00000020:00000080:0.0:1788535740.875663:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788535740.875669:0:6555:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788535740.875674:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe79af2f39bbdbfd4 00080000:01000000:0.0:1788535740.875678:0:6555:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788535740.875682:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdbfdb 00080000:10000000:0.0:1788535740.876129:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788535740.878105:0:6555:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788535740.889807:0:6555:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788535741.011633:0:6555:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788535741.012012:0:6555:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788535741.023242:0:6555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788535741.023624:0:6555:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788535741.028976:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009a38758b) 00000020:00000080:2.0:1788535741.028998:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788535741.029077:0:6555:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788535741.029095:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdbfe9 00000020:00000080:3.0:1788535741.033520:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788535741.034361:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788535741.039317:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788535741.048900:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788535741.057107:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788535741.064732:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788535741.069682:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788535741.082859:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe79af2f39bbdbff0 00000020:00000080:3.0:1788535741.083266:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788535741.083278:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535741.083284:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535741.083287:0:6555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788535741.083290:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535741.083294:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535741.083295:0:6555:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788535741.083298:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788535741.083299:0:6555:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788535741.083302:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535741.083305:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535741.083306:0:6555:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788535741.083308:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535741.083313:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535741.083314:0:6555:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788535741.083317:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788535741.083368:0:6555:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788535741.083624:0:6555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f2eeb44a pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:6555:1875415569270016:0@lo:502: 00000100:00100000:3.0:1788535741.083707:0:6555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535741.083759:0:6555:0:(client.c:2716:ptlrpc_set_wait()) set 0000000020e297d6 going to sleep for 11 seconds 00000100:00100000:2.0:1788535741.083811:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569270016 00000100:00100000:2.0:1788535741.083819:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569270016 00000100:00100000:2.0:1788535741.083867:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788535741.083876:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d67db81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+9:6555:x1875415569270016:12345-0@lo:502: 00000100:00100000:2.0:1788535741.083997:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d67db81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+9:6555:x1875415569270016:12345-0@lo:502: Request processed in 121us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535741.084005:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788535741.084221:0:6555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f2eeb44a pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:6555:1875415569270016:0@lo:502: 00000020:01000000:1.0:1788535741.084245:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535741.084249:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535741.084251:0:6555:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788535741.084255:0:6555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788535741.085739:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788535741.085771:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788535741.085795:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.085808:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535741.085835:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9005831fb800 from 1 10000000:01000000:2.0:1788535741.085838:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788535741.085873:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.085881:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.085890:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535741.085911:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000540a4af4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270144:0@lo:101: 00000100:00100000:2.0:1788535741.085970:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535741.086011:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fda7652 going to sleep for 11 seconds 00000100:00100000:3.0:1788535741.086176:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569270144 00000100:00100000:3.0:1788535741.086184:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569270144 00000100:00100000:3.0:1788535741.086231:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788535741.086239:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000796e44ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+9:6511:x1875415569270144:12345-0@lo:101: 00010000:00010000:3.0:1788535741.086251:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535741.086262:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdbff7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535741.086283:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdbff7 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535741.086303:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdbff7 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535741.086311:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c714282c, rc 0) 00000100:00100000:3.0:1788535741.086360:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000796e44ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+10:6511:x1875415569270144:12345-0@lo:101: Request processed in 122us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535741.086366:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788535741.086623:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000540a4af4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270144:0@lo:101: 00010000:00010000:1.0:1788535741.086641:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.086650:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535741.088561:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b6b0ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270272:0@lo:256: 00000100:00100000:1.0:1788535741.088643:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535741.088686:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c01ab6bb going to sleep for 11 seconds 00000100:00100000:3.0:1788535741.088791:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569270272 00000100:00100000:3.0:1788535741.088798:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569270272 00000100:00100000:3.0:1788535741.088841:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788535741.088848:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dce5147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+10:6511:x1875415569270272:12345-0@lo:256: 20000000:01000000:3.0:1788535741.088868:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788535741.088873:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788535741.088951:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dce5147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+10:6511:x1875415569270272:12345-0@lo:256: Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535741.088959:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788535741.089650:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b6b0ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270272:0@lo:256: 10000000:01000000:1.0:1788535741.090517:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788535741.090538:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.090550:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535741.090558:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831fb800 from 1 10000000:01000000:1.0:1788535741.090560:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788535741.090594:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.090601:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.090609:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535741.090626:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b6b0ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270400:0@lo:101: 00000100:00100000:1.0:1788535741.090683:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535741.090718:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c01ab6bb going to sleep for 11 seconds 00000100:00100000:1.0:1788535741.090741:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569270400 00000100:00100000:1.0:1788535741.090747:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569270400 00000100:00100000:1.0:1788535741.090779:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788535741.090785:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e79aed0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+10:6511:x1875415569270400:12345-0@lo:101: 00010000:00010000:1.0:1788535741.090794:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535741.090805:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc005 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.090824:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc005 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.090833:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc005 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.090840:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000abae60b1, rc 0) 00000100:00100000:1.0:1788535741.090871:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e79aed0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+11:6511:x1875415569270400:12345-0@lo:101: Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535741.090877:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788535741.090920:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b6b0ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270400:0@lo:101: 00010000:00010000:1.0:1788535741.090931:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.090939:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535741.090987:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b6b0ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270528:0@lo:501: 00000100:00100000:1.0:1788535741.091020:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535741.091034:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c01ab6bb going to sleep for 11 seconds 00000100:00100000:1.0:1788535741.091046:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569270528 00000100:00100000:1.0:1788535741.091050:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569270528 00000100:00100000:1.0:1788535741.091065:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788535741.091070:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b4a664e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+11:6511:x1875415569270528:12345-0@lo:501: 00000100:00100000:1.0:1788535741.091562:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b4a664e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+11:6511:x1875415569270528:12345-0@lo:501: Request processed in 491us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535741.091570:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788535741.091660:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b6b0ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270528:0@lo:501: 00000100:00100000:2.0:1788535741.091687:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a04dcd96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270656:0@lo:503: 00000100:00100000:2.0:1788535741.091723:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535741.091749:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fda7652 going to sleep for 11 seconds 00000100:00100000:3.0:1788535741.091785:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569270656 00000100:00100000:3.0:1788535741.091789:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569270656 00000100:00100000:3.0:1788535741.091818:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788535741.091824:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000663f171c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+11:6511:x1875415569270656:12345-0@lo:503: 00000040:00080000:3.0:1788535741.091853:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788535741.091894:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000663f171c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+11:6511:x1875415569270656:12345-0@lo:503: Request processed in 71us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535741.091900:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788535741.091979:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a04dcd96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270656:0@lo:503: 00000040:00080000:2.0:1788535741.093016:0:6559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788535741.093559:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788535741.093581:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788535741.093623:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.093636:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535741.093682:0:6511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788535741.093684:0:6511:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9005831fb800 10000000:01000000:1.0:1788535741.093687:0:6511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9005831fb800 10000000:01000000:1.0:1788535741.093690:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788535741.093694:0:6511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005831fb800 from 1 10000000:01000000:1.0:1788535741.093697:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788535741.093727:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.093735:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.093757:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535741.093776:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d649ac77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270784:0@lo:101: 00000100:00100000:1.0:1788535741.093825:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535741.093865:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c99ff0f going to sleep for 11 seconds 00000100:00100000:2.0:1788535741.093911:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569270784 00000100:00100000:2.0:1788535741.093917:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569270784 00000100:00100000:2.0:1788535741.093954:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788535741.093961:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ef3a513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+11:6511:x1875415569270784:12345-0@lo:101: 00010000:00010000:2.0:1788535741.093972:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535741.093982:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc013 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.094013:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc013 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.094022:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc013 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.094029:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089c589c5, rc 0) 00000100:00100000:2.0:1788535741.094072:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ef3a513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+12:6511:x1875415569270784:12345-0@lo:101: Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535741.094078:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788535741.094250:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d649ac77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270784:0@lo:101: 00010000:00010000:1.0:1788535741.094264:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.094272:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535741.094323:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d649ac77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270912:0@lo:501: 00000100:00100000:1.0:1788535741.094361:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535741.094383:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c99ff0f going to sleep for 11 seconds 00000100:00100000:2.0:1788535741.094649:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569270912 00000100:00100000:2.0:1788535741.094654:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569270912 00000100:00100000:2.0:1788535741.094689:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788535741.094695:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d1294d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:6511:x1875415569270912:12345-0@lo:501: 00000100:00100000:2.0:1788535741.094820:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d1294d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:6511:x1875415569270912:12345-0@lo:501: Request processed in 125us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535741.094826:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788535741.094895:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d649ac77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569270912:0@lo:501: 00000100:00100000:0.0:1788535741.094922:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004cb501a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569271040:0@lo:503: 00000100:00100000:0.0:1788535741.094962:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535741.094983:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 000000001049eed5 going to sleep for 11 seconds 00000100:00100000:2.0:1788535741.095035:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569271040 00000100:00100000:2.0:1788535741.095039:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569271040 00000100:00100000:2.0:1788535741.095069:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788535741.095076:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000753e8278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:6511:x1875415569271040:12345-0@lo:503: 00000100:00100000:2.0:1788535741.095183:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000753e8278 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:6511:x1875415569271040:12345-0@lo:503: Request processed in 108us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535741.095190:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788535741.095283:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004cb501a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569271040:0@lo:503: 00000100:00100000:2.0:1788535741.095868:0:6560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000364bcf5d pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:6560:1875415569271168:0@lo:502: 00000100:00100000:2.0:1788535741.095904:0:6560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535741.095938:0:6560:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7c056e6 going to sleep for 11 seconds 00000100:00100000:1.0:1788535741.095974:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569271168 00000100:00100000:1.0:1788535741.095979:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569271168 00000100:00100000:1.0:1788535741.096010:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788535741.096015:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcc380d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:6560:x1875415569271168:12345-0@lo:502: 00000100:00100000:1.0:1788535741.096177:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcc380d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:6560:x1875415569271168:12345-0@lo:502: Request processed in 161us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535741.096183:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788535741.096569:0:6560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000364bcf5d pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:6560:1875415569271168:0@lo:502: 00000020:01000004:3.0:1788535741.096624:0:6560:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788535741.096650:0:6560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007bdeecdb) 00000020:00000080:3.0:1788535741.096668:0:6560:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788535741.096752:0:6560:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000bedc66c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788535741.096756:0:6560:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000bedc66c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788535741.096758:0:6560:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000bedc66c 4 00010000:00080000:3.0:1788535741.096784:0:6560:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e98f9c24@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788535741.098903:0:6560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788535741.099181:0:6560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788535741.099227:0:6560:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788535741.099238:0:6560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe79af2f39bbdc028 00000100:00080000:3.0:1788535741.099247:0:6560:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788535741.099251:0:6560:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e98f9c24 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788535741.099280:0:6560:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000088640d4d x1875415569271296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788535741.099301:0:6560:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788535741.099514:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088640d4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569271296:0@lo:38: 00000100:00100000:2.0:1788535741.099572:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535741.099922:0:6560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a70724a pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:6560:1875415569271424:0@lo:502: 00000100:00100000:3.0:1788535741.099963:0:6560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535741.099983:0:6560:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009728040 going to sleep for 11 seconds 00000100:00100000:1.0:1788535741.100110:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569271296 00000100:00100000:1.0:1788535741.100117:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569271296 00000100:00100000:1.0:1788535741.100162:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535741.100168:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0bc49a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1875415569271296:12345-0@lo:38: 00000100:00100000:1.0:1788535741.100238:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0bc49a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1875415569271296:12345-0@lo:38: Request processed in 68us (665us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788535741.100246:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535741.100285:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788535741.100292:0:3659:0:(import.c:65:import_set_state_nolock()) 00000000e98f9c24 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788535741.100296:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788535741.100299:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088640d4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569271296:0@lo:38: 00000100:00100000:1.0:1788535741.100320:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569271424 00000100:00100000:1.0:1788535741.100323:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569271424 00000100:00100000:1.0:1788535741.100516:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788535741.100524:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000832c778e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+12:6560:x1875415569271424:12345-0@lo:502: 00000100:00100000:1.0:1788535741.100629:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000832c778e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+12:6560:x1875415569271424:12345-0@lo:502: Request processed in 107us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535741.100636:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788535741.100727:0:6560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a70724a pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:6560:1875415569271424:0@lo:502: 00000040:00080000:3.0:1788535741.100751:0:6560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788535741.100897:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788535741.100916:0:6511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788535741.100933:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.100943:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788535741.100986:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788535741.100989:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788535741.100990:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788535741.100991:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788535741.100992:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788535741.100994:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788535741.100995:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788535741.100997:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788535741.101002:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788535741.101003:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788535741.101004:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788535741.101005:0:6511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788535741.101008:0:6511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788535741.101010:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788535741.101011:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788535741.101012:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788535741.101013:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788535741.101014:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788535741.101015:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788535741.101015:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788535741.101016:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788535741.101017:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788535741.101018:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788535741.101018:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788535741.101019:0:6511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788535741.101034:0:6511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788535741.101044:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007af2dad6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569271552:0@lo:253: 00000100:00100000:1.0:1788535741.101074:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535741.101108:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000444f595f going to sleep for 11 seconds 00000100:00100000:1.0:1788535741.101123:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569271552 00000100:00100000:1.0:1788535741.101127:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569271552 00000100:00100000:1.0:1788535741.101177:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788535741.101182:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b11c599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:6511:x1875415569271552:12345-0@lo:253: 20000000:01000000:1.0:1788535741.101321:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788535741.101334:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788535741.117698:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788535741.117721:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788535741.117894:0:6549:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788535741.117899:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788535741.117918:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.117935:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdbff7 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.117942:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.117979:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdbff7 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535741.117993:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdbff7 expref: 12 pid: 6526 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535741.118004:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f89eec01 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569271680:0@lo:104: 00000100:00100000:2.0:1788535741.118065:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535741.118125:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ececd9e going to sleep for 11 seconds 00000100:00100000:1.0:1788535741.118271:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b11c599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:6511:x1875415569271552:12345-0@lo:253: Request processed in 17088us (17196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535741.118280:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788535741.118391:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007af2dad6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:6511:1875415569271552:0@lo:253: 10000000:01000000:2.0:1788535741.118401:0:6511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788535741.118404:0:6511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788535741.118406:0:6511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788535741.118407:0:6511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535741.118409:0:6511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535741.118410:0:6511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535741.118411:0:6511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535741.118412:0:6511:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788535741.118425:0:6511:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788535741.118427:0:6511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535741.118428:0:6511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535741.118429:0:6511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535741.118430:0:6511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788535741.118442:0:6511:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788535741.120440:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569271680 00000100:00100000:0.0:1788535741.120456:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569271680 00000100:00100000:0.0:1788535741.120524:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788535741.120534:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ed2633 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6549:x1875415569271680:12345-0@lo:104: 00010000:00010000:0.0:1788535741.120554:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535741.120642:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788535741.120648:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ed2633 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6549:x1875415569271680:12345-0@lo:104: Request processed in 116us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535741.120655:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788535741.120695:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f89eec01 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569271680:0@lo:104: 00010000:00010000:0.0:1788535741.120719:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.120771:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535741.120777:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.120796:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dda73ce3 already unused, calling callback (00000000e83cffe2) 10000000:00010000:1.0:1788535741.120799:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.120807:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535741.120813:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535741.120818:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535741.120859:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.120866:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535741.120892:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.120898:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdbff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdbffe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.120915:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535741.120916:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535741.120918:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535741.121419:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9897ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569271808:0@lo:103: 00000100:00100000:3.0:1788535741.121468:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535741.122057:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569271808 00000100:00100000:1.0:1788535741.122066:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569271808 00010000:00010000:1.0:1788535741.122109:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdbff7 expref: 12 pid: 6526 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535741.122137:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535741.122171:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a70724a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+12:3661:x1875415569271808:12345-0@lo:103: 00010000:00010000:1.0:1788535741.122183:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535741.122187:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdbff7 expref: 12 pid: 6526 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122197:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdbff7 expref: 12 pid: 6526 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122211:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c714282c/0xe79af2f39bbdbffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdbff7 expref: 12 pid: 6526 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122225:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122232:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788535741.122245:0:6519:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004347133s 00010000:00010000:1.0:1788535741.122249:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122255:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122260:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122266:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122270:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000765892a2 already unused, calling callback (000000003d13c388) 00010000:00010000:1.0:1788535741.122280:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122286:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122300:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122309:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535741.122351:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a70724a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+11:3661:x1875415569271808:12345-0@lo:103: Request processed in 183us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535741.122359:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535741.122395:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9897ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569271808:0@lo:103: 00010000:00010000:1.0:1788535741.122414:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122420:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535741.122425:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc02f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788535741.127994:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788535741.128274:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788535741.128514:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788535741.128676:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788535741.128834:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788535741.128982:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788535741.134231:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788535741.134408:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788535741.134608:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788535741.134768:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788535741.134958:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788535741.135177:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788535741.139750:0:6511:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788535741.146848:0:6511:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788535741.146914:0:6565:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788535741.146919:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788535741.147704:0:6566:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788535741.149549:0:6511:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788535741.149662:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788535741.150124:0:6511:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788535741.150131:0:6511:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788535741.150387:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535741.151624:0:6511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788535741.155376:0:6566:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535741.159513:0:6511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788535741.159592:0:6511:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788535741.159845:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788535741.165640:0:6511:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:2.0:1788535741.169123:0:6566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788535741.170117:0:6566:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788535741.170124:0:6566:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788535741.173464:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788535741.173606:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788535741.173752:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788535741.173861:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788535741.173983:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788535741.174129:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788535741.175636:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788535741.175845:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788535741.175992:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788535741.176188:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788535741.179964:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788535741.180677:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788535741.180844:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788535741.181140:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788535741.181636:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788535741.181776:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788535741.182543:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788535741.182719:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788535741.182868:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788535741.183020:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788535741.183504:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788535741.183647:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788535741.183761:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788535741.183870:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788535741.183989:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788535741.184543:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788535741.184742:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788535741.184887:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788535741.185391:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788535741.185551:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788535741.185676:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788535741.185804:0:6511:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788535741.188337:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788535741.191883:0:6511:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788535741.191925:0:6511:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa58c41c6b988 00100000:10000000:3.0:1788535741.191934:0:6511:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788535741.192638:0:6511:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788535741.192653:0:6511:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788535741.192668:0:6511:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788535741.192681:0:6511:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788535741.193460:0:6511:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788535741.193632:0:6511:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788535741.620472:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535742.636264:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535743.666047:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535744.693935:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535745.709293:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788535746.250500:0:6811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788535746.481195:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788535746.481205:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788535746.481208:0:8:0:(import.c:65:import_set_state_nolock()) 00000000e98f9c24 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788535746.481220:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e98f9c24 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788535746.481243:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e53812ee x1875415569272064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788535746.481279:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e53812ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569272064:0@lo:38: 00000100:00100000:1.0:1788535746.481344:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535746.481423:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9897ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569271936:0@lo:400: 00000100:00100000:3.0:1788535746.481464:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535746.481580:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569272064 00000100:00100000:3.0:1788535746.481588:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569272064 00000100:00100000:3.0:1788535746.481616:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535746.481622:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000675ee465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1875415569272064:12345-0@lo:38: 00010000:00080000:3.0:1788535746.481645:0:6535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:3.0:1788535746.481693:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe79af2f39bbdc036 00000004:00100000:3.0:1788535746.481736:0:6535:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788535746.481872:0:6535:0:(import.c:65:import_set_state_nolock()) 0000000050585094 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788535746.481919:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000675ee465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875415569272064:12345-0@lo:38: Request processed in 295us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535746.481926:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535746.482144:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569271936 00000100:00100000:1.0:1788535746.482168:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569271936 00000100:00100000:1.0:1788535746.482209:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788535746.482216:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac9d97fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+11:3662:x1875415569271936:12345-0@lo:400: 00000100:00100000:1.0:1788535746.482254:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac9d97fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+11:3662:x1875415569271936:12345-0@lo:400: Request processed in 39us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535746.482260:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788535746.482307:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e53812ee x1875415569272064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788535756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788535746.482321:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788535746.482328:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788535746.482331:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788535746.482333:0:3659:0:(import.c:65:import_set_state_nolock()) 00000000e98f9c24 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788535746.482339:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e53812ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569272064:0@lo:38: 00000100:00100000:1.0:1788535746.482379:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9897ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569271936:0@lo:400: 00010000:00010000:0.0:1788535746.732403:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788535747.245917:0:6863:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788535747.247926:0:6863:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788535747.756355:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535748.781193:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788535749.552473:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788535749.552482:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9005831fb800 from 3 10000000:01000000:3.0:1788535749.552487:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788535749.552534:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535749.552547:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535749.552559:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535749.552582:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005557f97e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569272192:0@lo:101: 00000100:00100000:3.0:1788535749.552642:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535749.552678:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000675549b4 going to sleep for 11 seconds 00000100:00100000:1.0:1788535749.552741:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569272192 00000100:00100000:1.0:1788535749.552749:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569272192 00000100:00100000:1.0:1788535749.552804:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788535749.552812:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ef0011a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+11:6531:x1875415569272192:12345-0@lo:101: 00010000:00010000:1.0:1788535749.552823:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535749.552834:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc03d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535749.552854:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc03d expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535749.552863:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc03d expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535749.552871:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074c85e85, rc 0) 00000100:00100000:1.0:1788535749.552902:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ef0011a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:6531:x1875415569272192:12345-0@lo:101: Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535749.552908:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788535749.553082:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005557f97e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569272192:0@lo:101: 00010000:00010000:3.0:1788535749.553095:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535749.553104:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535749.553261:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005557f97e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569272320:0@lo:256: 00000100:00100000:3.0:1788535749.553292:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535749.553343:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000675549b4 going to sleep for 11 seconds 00000100:00100000:1.0:1788535749.553743:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569272320 00000100:00100000:1.0:1788535749.553750:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569272320 00000100:00100000:1.0:1788535749.553787:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788535749.553795:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000153ee6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+12:6531:x1875415569272320:12345-0@lo:256: 20000000:01000000:1.0:1788535749.553811:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788535749.553827:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788535749.553830:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788535749.554112:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000153ee6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+12:6531:x1875415569272320:12345-0@lo:256: Request processed in 317us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535749.554120:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788535749.556060:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005557f97e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569272320:0@lo:256: 10000000:01000000:2.0:1788535749.556118:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788535749.556127:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535749.557035:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535749.804896:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788535750.144585:0:6964:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788535750.144798:0:6964:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788535750.829312:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535751.596686:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ec853ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569272448:0@lo:400: 00000100:00100000:3.0:1788535751.596789:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535751.597040:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569272448 00000100:00100000:1.0:1788535751.597050:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569272448 00000100:00100000:1.0:1788535751.597103:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788535751.597110:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a301973 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:3663:x1875415569272448:12345-0@lo:400: 00000100:00100000:2.0:1788535751.597271:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddafa11e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569272576:0@lo:400: 00000100:00100000:2.0:1788535751.597305:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535751.597362:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569272576 00000100:00100000:2.0:1788535751.597366:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569272576 00000100:00100000:2.0:1788535751.597397:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535751.597403:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0523eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569272576:12345-0@lo:400: 00000100:00100000:2.0:1788535751.597440:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0523eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569272576:12345-0@lo:400: Request processed in 38us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535751.597447:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788535751.597518:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ddafa11e x1875415569272576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535751.597534:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddafa11e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569272576:0@lo:400: 00000100:00100000:1.0:1788535751.605656:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a301973 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:3663:x1875415569272448:12345-0@lo:400: Request processed in 8535us (8856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535751.605685:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788535751.615822:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ec853ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569272448:0@lo:400: 00010000:00010000:2.0:1788535751.862056:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535752.876985:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535753.901742:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535754.924382:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535755.950107:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535756.716442:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e939e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569272832:0@lo:400: 00000100:00100000:0.0:1788535756.716529:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535756.716627:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535756.716642:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005419ece6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569272704:0@lo:400: 00000100:00100000:2.0:1788535756.716678:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535756.716735:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569272704 00000100:00100000:2.0:1788535756.716743:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569272704 00000100:00100000:2.0:1788535756.716786:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788535756.716794:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cb04963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+12:3660:x1875415569272704:12345-0@lo:400: 00000100:00100000:2.0:1788535756.716839:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cb04963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+12:3660:x1875415569272704:12345-0@lo:400: Request processed in 46us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535756.716846:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788535756.716889:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005419ece6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569272704:0@lo:400: 00000100:00100000:0.0:1788535756.719163:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569272832 00000100:00100000:0.0:1788535756.719178:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569272832 00000100:00100000:0.0:1788535756.719285:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788535756.719294:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cb501a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569272832:12345-0@lo:400: 00000100:00100000:0.0:1788535756.719380:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cb501a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569272832:12345-0@lo:400: Request processed in 87us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535756.719387:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788535756.719473:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008e939e2b x1875415569272832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535756.719489:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e939e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569272832:0@lo:400: 00010000:00010000:1.0:1788535756.973695:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535757.998402:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535759.021442:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788535759.742438:0:7463:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788535759.742442:0:7463:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788535759.742443:0:7463:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788535759.742576:0:7463:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d517d674 00000020:01000004:1.0:1788535759.742592:0:7463:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1788535759.742602:0:7463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788535759.742614:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000009c8b48a1) 00000020:00000080:1.0:1788535759.742630:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788535759.796028:0:7463:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788535759.796105:0:7463:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788535759.824388:0:7463:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788535759.824603:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788535759.824613:0:7463:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788535759.824625:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdc052 00000020:01000004:3.0:1788535759.824631:0:7463:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788535759.824652:0:7463:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788535759.824655:0:7463:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788535759.824660:0:7463:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788535759.824685:0:7463:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788535759.824689:0:7463:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788535759.857541:0:7463:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788535759.857586:0:7463:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788535759.857591:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788535759.857593:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788535759.857594:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535759.857595:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788535759.857596:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535759.857602:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535759.857603:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788535759.857604:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788535759.857605:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788535759.857607:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535759.857608:0:7463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788535759.857611:0:7463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788535759.857613:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788535759.857614:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788535759.857615:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535759.857615:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788535759.857616:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535759.857617:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535759.857618:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788535759.857619:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788535759.857619:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788535759.857620:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535759.857621:0:7463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788535759.857657:0:7463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788535759.857677:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569272960:0@lo:253: 00000100:00100000:0.0:1788535759.857742:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.857790:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c5e60e8 going to sleep for 11 seconds 00000100:00100000:1.0:1788535759.857845:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569272960 00000100:00100000:1.0:1788535759.857853:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569272960 00000100:00100000:1.0:1788535759.857911:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535759.857918:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc686401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569272960:12345-0@lo:253: 20000000:01000000:1.0:1788535759.857947:0:6528:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788535759.857968:0:6528:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788535759.857973:0:6528:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788535759.857976:0:6528:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788535759.858019:0:6528:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788535759.858870:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535759.859031:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788535759.859047:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788535759.859360:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788535759.859583:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788535759.859604:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788535759.859675:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788535759.859683:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788535759.859697:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788535759.859703:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788535759.859713:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788535759.859718:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788535759.859730:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788535759.859745:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788535759.859839:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788535759.859859:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788535759.859874:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788535759.859880:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788535759.859894:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788535759.859899:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1788535759.859913:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788535759.859917:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788535759.859931:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788535759.859946:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788535759.859970:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788535759.860042:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788535759.860055:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788535759.860142:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788535759.860362:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788535759.860378:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788535759.860383:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788535759.860393:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788535759.860409:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788535759.860414:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788535759.860436:0:6528:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788535759.860443:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788535759.860723:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788535759.860917:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788535759.860935:0:6528:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:2.0:1788535759.860937:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788535759.860950:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788535759.860969:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788535759.860983:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788535759.860988:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1788535759.861005:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788535759.861012:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788535759.861038:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788535759.861054:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788535759.861345:0:6528:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788535759.861354:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788535759.861617:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788535759.861775:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788535759.861791:0:6528:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:2.0:1788535759.861793:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1788535759.861805:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788535759.861810:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788535759.861824:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788535759.861829:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1788535759.861842:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788535759.861847:0:6528:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788535759.861859:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788535759.861873:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788535759.861891:0:6528:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788535759.861894:0:6528:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788535759.861898:0:6528:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788535759.861938:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788535759.861940:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788535759.862669:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788535759.862697:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788535759.862713:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788535759.862858:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788535759.862877:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788535759.862898:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788535759.862906:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788535759.862908:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788535759.863414:0:7472:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788535759.863434:0:7472:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788535759.863449:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788535759.863590:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788535759.863610:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788535759.863624:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788535759.863633:0:6528:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788535759.863634:0:6528:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788535759.863907:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788535759.863923:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788535759.863937:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788535759.864132:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788535759.864358:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788535759.864389:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788535759.864402:0:6528:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788535759.864404:0:6528:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788535759.864410:0:6528:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788535759.864418:0:6528:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788535759.864681:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788535759.864786:0:6528:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788535759.872625:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788535759.872762:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.872794:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdbf87 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.872801:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdbfa3 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.872808:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc013 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.872814:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.872857:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc013 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.872871:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc013 expref: 12 pid: 6529 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.872885:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0499622 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875415569273088:0@lo:104: 00000100:00100000:0.0:1788535759.872948:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535759.873057:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdbfa3 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.873136:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdbfa3 expref: 12 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.873530:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee1fca53 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875415569273216:0@lo:104: 00000100:00100000:0.0:1788535759.873561:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535759.873707:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdbf87 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.873724:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdbf87 expref: 12 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.873733:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4e16d47 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875415569273344:0@lo:104: 00000100:00100000:0.0:1788535759.873756:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535759.873777:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569273088 00000100:00100000:1.0:1788535759.873784:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569273088 00000100:00100000:2.0:1788535759.873837:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569273216 00000100:00100000:2.0:1788535759.873841:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569273216 00000100:00100000:2.0:1788535759.873863:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788535759.873870:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000274d3f96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:6528:x1875415569273088:12345-0@lo:104: 00010000:00010000:2.0:1788535759.873882:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.873937:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535759.873942:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000274d3f96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:6528:x1875415569273088:12345-0@lo:104: Request processed in 73us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.873949:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788535759.873981:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535759.873986:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022b4d771 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6528:x1875415569273216:12345-0@lo:104: 00010000:00010000:2.0:1788535759.873993:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.874023:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788535759.874028:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022b4d771 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6528:x1875415569273216:12345-0@lo:104: Request processed in 43us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.874033:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788535759.874183:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788535759.874190:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874197:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000059fd352 already unused, calling callback (00000000e83cffe2) 10000000:00010000:3.0:1788535759.874201:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874208:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535759.874214:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535759.874226:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535759.874253:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874260:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535759.874277:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874283:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000059fd352/0xe79af2f39bbdc013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc01a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874293:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535759.874295:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874299:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e8c8f52e already unused, calling callback (00000000e83cffe2) 10000000:00010000:3.0:1788535759.874301:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874306:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535759.874310:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535759.874314:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535759.874324:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874330:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535759.874349:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874355:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000e8c8f52e/0xe79af2f39bbdbfa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdbfaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874364:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535759.874366:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535759.874367:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535759.874382:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e939e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569273472:0@lo:103: 00000100:00100000:3.0:1788535759.874413:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535759.874456:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f2784432 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569273600:0@lo:103: 00000100:00100000:3.0:1788535759.874476:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535759.874509:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569273472 00000100:00100000:3.0:1788535759.874513:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569273472 00010000:00010000:3.0:1788535759.874531:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc013 expref: 13 pid: 6529 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535759.874549:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569273600 00000100:00100000:3.0:1788535759.874552:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569273600 00010000:00010000:3.0:1788535759.874560:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdbfa3 expref: 14 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535759.874571:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535759.874575:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adf737c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+14:3663:x1875415569273472:12345-0@lo:103: 00010000:00010000:3.0:1788535759.874584:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535759.874588:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc013 expref: 14 pid: 6529 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874596:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc013 expref: 14 pid: 6529 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874618:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535759.874646:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adf737c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+14:3663:x1875415569273472:12345-0@lo:103: Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535759.874653:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535759.874665:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535759.874671:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062fa239b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+13:3660:x1875415569273600:12345-0@lo:103: 00010000:00010000:3.0:1788535759.874677:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535759.874681:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdbfa3 expref: 13 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874688:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdbfa3 expref: 13 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.874697:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535759.874720:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062fa239b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+13:3660:x1875415569273600:12345-0@lo:103: Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535759.874725:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535759.874761:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f2784432 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569273600:0@lo:103: 00000100:00100000:3.0:1788535759.874785:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e939e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569273472:0@lo:103: 00000100:00100000:0.0:1788535759.874911:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dcab4114 going to sleep for 11 seconds 00010000:00010000:0.0:1788535759.874925:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000089c589c5/0xe79af2f39bbdc01a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc013 expref: 12 pid: 6529 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.874935:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0499622 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875415569273088:0@lo:104: 00010000:00010000:0.0:1788535759.874942:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d71a1fcc/0xe79af2f39bbdbfaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdbfa3 expref: 11 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.874950:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee1fca53 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875415569273216:0@lo:104: 00000100:00100000:2.0:1788535759.875013:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569273344 00000100:00100000:2.0:1788535759.875017:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569273344 00000100:00100000:2.0:1788535759.875040:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535759.875045:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052b9fcc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6528:x1875415569273344:12345-0@lo:104: 00010000:00010000:2.0:1788535759.875052:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.875177:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535759.875182:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052b9fcc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6528:x1875415569273344:12345-0@lo:104: Request processed in 138us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.875188:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788535759.875253:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4e16d47 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6528:1875415569273344:0@lo:104: 00010000:00010000:0.0:1788535759.875272:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875355:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535759.875359:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875365:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004cdffccf already unused, calling callback (00000000e83cffe2) 10000000:00010000:3.0:1788535759.875367:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875384:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535759.875389:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535759.875394:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535759.875456:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875463:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535759.875484:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875491:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdbf87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdbf8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875503:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535759.875504:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535759.875506:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535759.875511:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535759.875518:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e939e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569273728:0@lo:103: 00000100:00100000:3.0:1788535759.875542:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535759.875568:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569273728 00000100:00100000:3.0:1788535759.875572:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569273728 00010000:00010000:3.0:1788535759.875582:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdbf87 expref: 11 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535759.875598:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788535759.875602:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2784432 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+11:3660:x1875415569273728:12345-0@lo:103: 00010000:00010000:3.0:1788535759.875617:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535759.875620:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdbf87 expref: 11 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875627:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdbf87 expref: 11 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875635:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046b200fa/0xe79af2f39bbdbf8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdbf87 expref: 11 pid: 6528 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875645:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875652:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875664:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875670:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875676:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875681:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875687:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fc0aecc5 already unused, calling callback (000000003d13c388) 00010000:00010000:3.0:1788535759.875690:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875706:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875717:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875726:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535759.875751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2784432 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+10:3660:x1875415569273728:12345-0@lo:103: Request processed in 149us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535759.875758:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788535759.875783:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e939e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569273728:0@lo:103: 00010000:00010000:3.0:1788535759.875797:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875803:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.875808:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc059 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788535759.875824:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:1.0:1788535759.876431:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535759.877867:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc686401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+9:7463:x1875415569272960:12345-0@lo:253: Request processed in 19942us (20117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535759.877883:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788535759.877999:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569272960:0@lo:253: 10000000:01000000:0.0:1788535759.878015:0:7463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788535759.878018:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788535759.878020:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788535759.878022:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788535759.878023:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788535759.878024:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788535759.878025:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788535759.878026:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788535759.878028:0:7463:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788535759.878029:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788535759.878040:0:7463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788535759.878056:0:7463:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d517d674 from lustre-MDT0001 10000000:01000000:0.0:1788535759.878097:0:7463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788535759.878100:0:7463:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788535759.878106:0:7463:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9005baf299c0 local copy 10000000:01000000:0.0:1788535759.878110:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788535759.878240:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.878252:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.878261:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.878278:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569273856:0@lo:101: 00000100:00100000:0.0:1788535759.878311:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.878345:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000003600dc7c going to sleep for 11 seconds 00000100:00100000:3.0:1788535759.878439:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569273856 00000100:00100000:3.0:1788535759.878445:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569273856 00000100:00100000:3.0:1788535759.878475:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788535759.878481:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098732066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+9:7463:x1875415569273856:12345-0@lo:101: 00010000:00010000:3.0:1788535759.878500:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535759.878511:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3945757/0xe79af2f39bbdc067 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc060 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.878532:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3945757/0xe79af2f39bbdc067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc060 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.878542:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3945757/0xe79af2f39bbdc067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc060 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535759.878550:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3945757, rc 0) 00000100:00100000:3.0:1788535759.878579:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098732066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+10:7463:x1875415569273856:12345-0@lo:101: Request processed in 98us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535759.878585:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788535759.879024:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569273856:0@lo:101: 00010000:00010000:0.0:1788535759.879037:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.879046:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.879322:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569273984:0@lo:501: 00000100:00100000:0.0:1788535759.879356:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.879415:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000003600dc7c going to sleep for 11 seconds 00000100:00100000:3.0:1788535759.879445:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569273984 00000100:00100000:3.0:1788535759.879449:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569273984 00000100:00100000:3.0:1788535759.879515:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788535759.879522:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039110de1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+10:7463:x1875415569273984:12345-0@lo:501: 00000100:00100000:3.0:1788535759.879585:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039110de1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+10:7463:x1875415569273984:12345-0@lo:501: Request processed in 64us (229us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788535759.879591:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788535759.879642:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569273984:0@lo:501: 10000000:01000000:0.0:1788535759.879657:0:7463:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788535759.879678:0:7463:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788535759.879682:0:7463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.879689:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.879695:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.879719:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788535759.879740:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9005831a8000 10000000:01000000:0.0:1788535759.879745:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788535759.879749:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9005baf299c0 10000000:01000000:0.0:1788535759.879751:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788535759.879755:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9005baf299c0 from 1 10000000:01000000:0.0:1788535759.879757:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788535759.879774:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000001a83ccb5/0xe79af2f39bbdc06e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.879781:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000001a83ccb5/0xe79af2f39bbdc06e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.879787:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000001a83ccb5/0xe79af2f39bbdc06e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.879797:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274112:0@lo:101: 00000100:00100000:0.0:1788535759.879821:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535759.879853:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535759.879858:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535759.879865:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe24b14a already unused, calling callback (00000000e83cffe2) 10000000:00010000:1.0:1788535759.879868:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535759.879875:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535759.879881:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535759.879886:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535759.879906:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535759.879912:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535759.879933:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535759.879949:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc060 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe79af2f39bbdc067 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535759.879974:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535759.879976:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535759.879977:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535759.880087:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c93f92b going to sleep for 11 seconds 00000100:00100000:2.0:1788535759.880285:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569274112 00000100:00100000:2.0:1788535759.880290:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569274112 00000100:00100000:2.0:1788535759.880314:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788535759.880320:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7185524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+10:7463:x1875415569274112:12345-0@lo:101: 00010000:00010000:2.0:1788535759.880328:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535759.880340:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c1adfb2/0xe79af2f39bbdc075 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc06e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.880356:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c1adfb2/0xe79af2f39bbdc075 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc06e expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.880366:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c1adfb2/0xe79af2f39bbdc075 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc06e expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.880373:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c1adfb2, rc 0) 00000100:00100000:2.0:1788535759.880401:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7185524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+11:7463:x1875415569274112:12345-0@lo:101: Request processed in 82us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.880406:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788535759.880490:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274112:0@lo:101: 00010000:00010000:0.0:1788535759.880505:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000001a83ccb5/0xe79af2f39bbdc06e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc075 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.880511:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000001a83ccb5/0xe79af2f39bbdc06e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc075 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535759.880524:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788535759.880538:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000001a83ccb5/0xe79af2f39bbdc06e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc075 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.880544:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000001a83ccb5/0xe79af2f39bbdc06e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc075 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535759.880552:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9005831a8000 10000000:01000000:0.0:1788535759.880555:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788535759.880559:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9005831a8000 from 1 10000000:01000000:0.0:1788535759.880561:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788535759.880573:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000009b5931dc/0xe79af2f39bbdc07c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.880579:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000009b5931dc/0xe79af2f39bbdc07c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.880585:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000009b5931dc/0xe79af2f39bbdc07c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.880595:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274368:0@lo:101: 00000100:00100000:0.0:1788535759.880618:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.880636:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c93f92b going to sleep for 11 seconds 00000100:00100000:2.0:1788535759.880686:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569274368 00000100:00100000:2.0:1788535759.880691:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569274368 00000100:00100000:2.0:1788535759.880707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788535759.880712:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042832d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+11:7463:x1875415569274368:12345-0@lo:101: 00010000:00010000:2.0:1788535759.880719:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535759.880725:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001ebbe73b/0xe79af2f39bbdc083 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc07c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.880736:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ebbe73b/0xe79af2f39bbdc083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc07c expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.880742:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001ebbe73b/0xe79af2f39bbdc083 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc07c expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.880748:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001ebbe73b, rc 0) 00000100:00100000:2.0:1788535759.880779:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042832d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569274368:12345-0@lo:101: Request processed in 67us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.880784:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788535759.880855:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274368:0@lo:101: 00010000:00010000:0.0:1788535759.880870:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000009b5931dc/0xe79af2f39bbdc07c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.880876:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000009b5931dc/0xe79af2f39bbdc07c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535759.880883:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788535759.880896:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000009b5931dc/0xe79af2f39bbdc07c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.880901:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000009b5931dc/0xe79af2f39bbdc07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535759.880907:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788535759.880910:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788535759.880914:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9005831a8000 10000000:01000000:0.0:1788535759.880916:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788535759.880918:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788535759.880919:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788535759.880931:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000000136dd42/0xe79af2f39bbdc08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.880936:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000000136dd42/0xe79af2f39bbdc08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.880942:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000000136dd42/0xe79af2f39bbdc08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.880961:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274496:0@lo:101: 00000100:00100000:0.0:1788535759.880984:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.881006:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c93f92b going to sleep for 11 seconds 00000100:00100000:2.0:1788535759.881057:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569274496 00000100:00100000:2.0:1788535759.881061:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569274496 00000100:00100000:2.0:1788535759.881088:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788535759.881093:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1dc2a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569274496:12345-0@lo:101: 00010000:00010000:2.0:1788535759.881100:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535759.881106:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a74ece2/0xe79af2f39bbdc091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc08a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.881117:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a74ece2/0xe79af2f39bbdc091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc08a expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.881124:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a74ece2/0xe79af2f39bbdc091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc08a expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.881136:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a74ece2, rc 0) 00000100:00100000:2.0:1788535759.881192:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1dc2a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+13:7463:x1875415569274496:12345-0@lo:101: Request processed in 98us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.881198:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788535759.881479:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9897ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569274240:0@lo:103: 00000100:00100000:3.0:1788535759.881508:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535759.881607:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569274240 00000100:00100000:2.0:1788535759.881611:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569274240 00000100:00100000:2.0:1788535759.881644:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535759.881649:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e939e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+13:3662:x1875415569274240:12345-0@lo:103: 00010000:00010000:2.0:1788535759.881657:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535759.881668:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3945757/0xe79af2f39bbdc067 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc060 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.881678:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535759.881702:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e939e2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+12:3662:x1875415569274240:12345-0@lo:103: Request processed in 53us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.881707:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535759.881766:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9897ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569274240:0@lo:103: 00000100:00100000:0.0:1788535759.881915:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274496:0@lo:101: 00010000:00010000:0.0:1788535759.881926:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000000136dd42/0xe79af2f39bbdc08a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.881932:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000000136dd42/0xe79af2f39bbdc08a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.882021:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274624:0@lo:501: 00000100:00100000:0.0:1788535759.882044:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.882141:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c93f92b going to sleep for 11 seconds 00000100:00100000:2.0:1788535759.882284:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569274624 00000100:00100000:2.0:1788535759.882288:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569274624 00000100:00100000:2.0:1788535759.882347:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788535759.882354:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e208652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569274624:12345-0@lo:501: 00000100:00100000:2.0:1788535759.882454:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e208652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569274624:12345-0@lo:501: Request processed in 101us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.882460:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788535759.882508:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274624:0@lo:501: 00000100:00100000:0.0:1788535759.882531:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274752:0@lo:503: 00000100:00100000:0.0:1788535759.882571:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.882636:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c93f92b going to sleep for 11 seconds 00000100:00100000:3.0:1788535759.882688:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569274752 00000100:00100000:3.0:1788535759.882692:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569274752 00000100:00100000:3.0:1788535759.882712:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788535759.882716:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cd4dbd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569274752:12345-0@lo:503: 00000100:00100000:3.0:1788535759.882816:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cd4dbd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569274752:12345-0@lo:503: Request processed in 99us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535759.882823:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788535759.882894:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274752:0@lo:503: 00000040:00080000:0.0:1788535759.883240:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788535759.883295:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274880:0@lo:502: 00000100:00100000:0.0:1788535759.883328:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.883350:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043bdb9e1 going to sleep for 11 seconds 00000100:00100000:3.0:1788535759.883402:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569274880 00000100:00100000:3.0:1788535759.883407:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569274880 00000100:00100000:3.0:1788535759.883424:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788535759.883429:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f15518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569274880:12345-0@lo:502: 00000100:00100000:3.0:1788535759.883505:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f15518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569274880:12345-0@lo:502: Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535759.883512:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788535759.883580:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569274880:0@lo:502: 00000040:00080000:0.0:1788535759.883764:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788535759.883788:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1788535759.883802:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1788535759.883816:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1788535759.883829:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1788535759.883840:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1788535759.883863:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1788535759.883875:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1788535759.883886:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1788535759.883899:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1788535759.883912:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1788535759.883925:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1788535759.883939:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1788535759.883962:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1788535759.883977:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1788535759.883988:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1788535759.883998:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1788535759.884009:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1788535759.884019:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1788535759.884029:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1788535759.884040:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1788535759.884050:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1788535759.884061:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1788535759.884173:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275008:0@lo:502: 00000100:00100000:0.0:1788535759.884207:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.884228:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000043bdb9e1 going to sleep for 11 seconds 00000100:00100000:2.0:1788535759.884279:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569275008 00000100:00100000:2.0:1788535759.884284:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569275008 00000100:00100000:2.0:1788535759.884307:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788535759.884313:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c2b0b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569275008:12345-0@lo:502: 00000100:00100000:2.0:1788535759.884394:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c2b0b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569275008:12345-0@lo:502: Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.884401:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788535759.884467:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275008:0@lo:502: 00000040:00080000:0.0:1788535759.884505:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788535759.884512:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788535759.885001:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535759.885012:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535759.885015:0:7475:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788535759.885020:0:7475:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788535759.885023:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788535759.885035:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000006b37d8e) 00000020:00000080:3.0:1788535759.885052:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788535759.885058:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788535759.885390:0:7475:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788535759.885398:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdc09f 00000020:00000080:3.0:1788535759.885593:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788535759.885598:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535759.885601:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535759.885602:0:7475:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788535759.885605:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535759.885609:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535759.885610:0:7475:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788535759.885613:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788535759.885619:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000b3a8fb3e) 00000020:00000080:3.0:1788535759.885630:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788535759.885641:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788535759.885643:0:7475:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788535759.885645:0:7475:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788535759.885651:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788535759.885693:0:7475:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d517d674 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788535759.885705:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000b5c5693d) 00000020:00000080:3.0:1788535759.885715:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788535759.885777:0:7475:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788535759.885783:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdc0b4 00000020:00000080:3.0:1788535759.885867:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788535759.885874:0:7475:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788535759.885878:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe79af2f39bbdc0bb 00080000:01000000:3.0:1788535759.885882:0:7475:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788535759.885885:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdc0c2 00080000:10000000:3.0:1788535759.886439:0:7475:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788535759.886569:0:7475:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788535759.973987:0:7475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788535759.975568:0:7475:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1788535759.978672:0:7475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788535759.979045:0:7475:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788535759.987907:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788535759.987919:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535759.987925:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535759.987928:0:7475:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788535759.987931:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535759.987937:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535759.987939:0:7475:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788535759.987942:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788535759.987946:0:7475:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:00000080:2.0:1788535759.987990:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788535759.988003:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000c4b1d38e) 00000020:00000080:2.0:1788535759.988022:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788535759.988026:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788535759.988097:0:7475:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788535759.988104:0:7475:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788535759.988110:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdc0d0 00010000:00080000:2.0:1788535759.988171:0:7475:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006c773a69@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788535759.994092:0:7475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1788535759.996603:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788535759.996619:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788535759.996658:0:7475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788535759.996690:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdc0d7 00000100:00080000:2.0:1788535759.996702:0:7475:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788535759.996707:0:7475:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000006c773a69 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788535759.996741:0:7475:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001ec853ab x1875415569275136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788535759.996782:0:7475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788535759.996867:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535759.996871:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535759.996873:0:7475:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788535759.996876:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788535759.996879:0:7475:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788535759.996880:0:7475:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788535759.996882:0:7475:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788535759.996883:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788535759.996885:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535759.996886:0:7475:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788535759.996888:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535759.996893:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535759.996894:0:7475:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788535759.996898:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788535759.996928:0:7475:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788535759.996940:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535759.996943:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535759.996944:0:7475:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788535759.996947:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535759.996949:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535759.996961:0:7475:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788535759.996965:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788535759.996966:0:7475:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788535759.996990:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535759.996992:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535759.996993:0:7475:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788535759.996996:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1788535759.997222:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ec853ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569275136:0@lo:38: 00000100:00100000:3.0:1788535759.997298:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535759.997359:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddafa11e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569275264:0@lo:400: 00000100:00100000:3.0:1788535759.997387:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535759.997545:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569275264 00000100:00100000:3.0:1788535759.997554:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569275264 00000100:00100000:3.0:1788535759.997595:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535759.997603:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c32e4da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569275264:12345-0@lo:400: 00000100:00100000:3.0:1788535759.997651:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c32e4da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569275264:12345-0@lo:400: Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535759.997658:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788535759.997694:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ddafa11e x1875415569275264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535759.997706:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddafa11e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569275264:0@lo:400: 00000020:01000000:0.0:1788535759.997820:0:7463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1788535759.997851:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788535759.997863:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000000136dd42/0xe79af2f39bbdc08a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.997873:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000000136dd42/0xe79af2f39bbdc08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535759.997888:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9005831a8000 from 1 10000000:01000000:0.0:1788535759.997891:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788535759.997913:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.997920:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.997930:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.997945:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275392:0@lo:101: 00000100:00100000:0.0:1788535759.997984:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.997997:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e337bc6 going to sleep for 11 seconds 00000100:00100000:2.0:1788535759.998202:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569275136 00000100:00100000:2.0:1788535759.998208:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569275136 00000100:00100000:2.0:1788535759.998227:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535759.998243:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065592af5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569275136:12345-0@lo:38: 00010000:00080000:2.0:1788535759.998268:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1788535759.998296:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdc0e5 00000004:00100000:2.0:1788535759.998309:0:6538:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788535759.998314:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788535759.998380:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569275392 00000100:00100000:2.0:1788535759.998383:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569275392 00000100:00100000:2.0:1788535759.998405:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788535759.998411:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e1bb6b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+12:7463:x1875415569275392:12345-0@lo:101: 00010000:00010000:2.0:1788535759.998534:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535759.998547:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc0de expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.998566:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc0de expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.998576:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc0de expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535759.998584:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000765892a2, rc 0) 00000100:00100000:2.0:1788535759.998621:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e1bb6b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+13:7463:x1875415569275392:12345-0@lo:101: Request processed in 211us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535759.998627:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788535759.998799:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275392:0@lo:101: 00010000:00010000:0.0:1788535759.998813:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535759.998820:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535759.999707:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275520:0@lo:256: 00000100:00100000:0.0:1788535759.999757:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535759.999829:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e337bc6 going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.004074:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569275520 00000100:00100000:1.0:1788535760.004100:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569275520 00000100:00100000:1.0:1788535760.004176:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788535760.004186:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000751f43f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+13:7463:x1875415569275520:12345-0@lo:256: 20000000:01000000:1.0:1788535760.005337:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788535760.005361:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788535760.005365:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788535760.005708:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000751f43f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+13:7463:x1875415569275520:12345-0@lo:256: Request processed in 1521us (5949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.005720:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788535760.006105:0:6538:0:(import.c:65:import_set_state_nolock()) 000000001d8fe2b2 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788535760.006192:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065592af5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1875415569275136:12345-0@lo:38: Request processed in 7948us (8894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535760.006204:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535760.006396:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788535760.006405:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788535760.006412:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788535760.006418:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788535760.006429:0:3659:0:(import.c:65:import_set_state_nolock()) 000000006c773a69 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788535760.006444:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ec853ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569275136:0@lo:38: 00000100:00100000:1.0:1788535760.006784:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae01dff4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569275648:0@lo:41: 00000100:00100000:1.0:1788535760.006827:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535760.006921:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569275648 00000100:00100000:3.0:1788535760.006928:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569275648 00000100:00100000:3.0:1788535760.006971:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535760.006978:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e53812ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3660:x1875415569275648:12345-0@lo:41: 00000004:00000024:3.0:1788535760.007002:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788535760.007047:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e53812ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3660:x1875415569275648:12345-0@lo:41: Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535760.007053:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535760.007220:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae01dff4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569275648:0@lo:41: 00000100:00100000:0.0:1788535760.007588:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275520:0@lo:256: 10000000:01000000:0.0:1788535760.008409:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788535760.008551:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.008574:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535760.008584:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831a8000 from 1 10000000:01000000:0.0:1788535760.008587:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788535760.008617:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.008624:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.008632:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535760.008649:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275776:0@lo:101: 00000100:00100000:0.0:1788535760.008697:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535760.008738:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e337bc6 going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.008801:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569275776 00000100:00100000:1.0:1788535760.008808:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569275776 00000100:00100000:1.0:1788535760.008851:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788535760.008858:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f46700f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+13:7463:x1875415569275776:12345-0@lo:101: 00010000:00010000:1.0:1788535760.008868:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535760.008882:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc0f3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.008903:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc0f3 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.008914:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc0f3 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.008922:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000059fd352, rc 0) 00000100:00100000:1.0:1788535760.008972:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f46700f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:7463:x1875415569275776:12345-0@lo:101: Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.008978:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535760.009059:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f72336a pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275776:0@lo:101: 00010000:00010000:2.0:1788535760.009083:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.009098:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535760.009243:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081757850 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275904:0@lo:501: 00000100:00100000:2.0:1788535760.009271:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535760.009289:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a37b64d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788535760.009463:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569275904 00000100:00100000:0.0:1788535760.009468:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569275904 00000100:00100000:0.0:1788535760.009501:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788535760.009507:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5b1c288 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+14:7463:x1875415569275904:12345-0@lo:501: 00000100:00100000:0.0:1788535760.009595:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5b1c288 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+14:7463:x1875415569275904:12345-0@lo:501: Request processed in 89us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535760.009602:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788535760.009722:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081757850 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569275904:0@lo:501: 00000100:00100000:2.0:1788535760.009747:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081757850 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276032:0@lo:503: 00000100:00100000:2.0:1788535760.009785:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535760.009811:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a37b64d6 going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.009864:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569276032 00000100:00100000:1.0:1788535760.009868:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569276032 00000100:00100000:1.0:1788535760.009898:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788535760.009903:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f344169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:7463:x1875415569276032:12345-0@lo:503: 00000040:00080000:1.0:1788535760.009935:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788535760.009980:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f344169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:7463:x1875415569276032:12345-0@lo:503: Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.009986:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788535760.010072:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081757850 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276032:0@lo:503: 00000040:00080000:2.0:1788535760.010350:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788535760.010398:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788535760.010641:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788535760.011819:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788535760.012343:0:7463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788535760.012369:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788535760.012483:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.012496:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535760.012547:0:7463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788535760.012549:0:7463:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9005831a8000 10000000:01000000:2.0:1788535760.012552:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9005831a8000 10000000:01000000:2.0:1788535760.012556:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788535760.012560:0:7463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005831a8000 from 1 10000000:01000000:2.0:1788535760.012563:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788535760.012595:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdc101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.012612:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdc101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.012621:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdc101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535760.012641:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081757850 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276160:0@lo:101: 00000100:00100000:2.0:1788535760.012698:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535760.012771:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7c056e6 going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.012835:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569276160 00000100:00100000:1.0:1788535760.012844:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569276160 00000100:00100000:1.0:1788535760.012917:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788535760.012925:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d93e2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:7463:x1875415569276160:12345-0@lo:101: 00010000:00010000:1.0:1788535760.012937:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535760.012948:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000597e53e3/0xe79af2f39bbdc108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc101 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.012979:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000597e53e3/0xe79af2f39bbdc108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc101 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.012989:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000597e53e3/0xe79af2f39bbdc108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc101 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.012998:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000597e53e3, rc 0) 00000100:00100000:1.0:1788535760.013045:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d93e2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276160:12345-0@lo:101: Request processed in 120us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.013051:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788535760.013337:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081757850 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276160:0@lo:101: 00010000:00010000:3.0:1788535760.013351:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdc101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535760.013359:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdc101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535760.013470:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276288:0@lo:501: 00000100:00100000:3.0:1788535760.013500:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535760.013670:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000097ea4fc7 going to sleep for 11 seconds 00000100:00100000:2.0:1788535760.013735:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569276288 00000100:00100000:2.0:1788535760.013740:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569276288 00000100:00100000:2.0:1788535760.013764:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788535760.013769:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a88a754 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276288:12345-0@lo:501: 00000100:00100000:2.0:1788535760.013870:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a88a754 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276288:12345-0@lo:501: Request processed in 101us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535760.013877:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788535760.013943:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276288:0@lo:501: 00000100:00100000:3.0:1788535760.013979:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276416:0@lo:503: 00000100:00100000:3.0:1788535760.014014:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535760.014035:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000097ea4fc7 going to sleep for 11 seconds 00000100:00100000:2.0:1788535760.014099:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569276416 00000100:00100000:2.0:1788535760.014103:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569276416 00000100:00100000:2.0:1788535760.014121:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788535760.014126:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c08319c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276416:12345-0@lo:503: 00000100:00100000:2.0:1788535760.014217:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c08319c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276416:12345-0@lo:503: Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535760.014224:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788535760.014355:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276416:0@lo:503: 00000040:00080000:3.0:1788535760.014635:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788535760.014701:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276544:0@lo:502: 00000100:00100000:3.0:1788535760.014732:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535760.014763:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000097ea4fc7 going to sleep for 11 seconds 00000100:00100000:2.0:1788535760.014863:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569276544 00000100:00100000:2.0:1788535760.014867:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569276544 00000100:00100000:2.0:1788535760.014885:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788535760.014889:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf3a7165 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276544:12345-0@lo:502: 00000100:00100000:2.0:1788535760.014976:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf3a7165 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276544:12345-0@lo:502: Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535760.014982:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788535760.015269:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276544:0@lo:502: 00000040:00080000:3.0:1788535760.015541:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788535760.015579:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788535760.015595:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788535760.015609:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788535760.015622:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788535760.015635:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788535760.015646:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788535760.015658:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788535760.015670:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788535760.015682:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788535760.015694:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788535760.015707:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788535760.015720:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788535760.015732:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788535760.015744:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788535760.015756:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788535760.015768:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788535760.015791:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788535760.015806:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788535760.015819:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788535760.015832:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788535760.015845:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788535760.015858:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788535760.015870:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788535760.015891:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788535760.015903:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788535760.015915:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788535760.015926:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788535760.015962:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276672:0@lo:502: 00000100:00100000:3.0:1788535760.016008:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535760.016087:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000097ea4fc7 going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.016224:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569276672 00000100:00100000:1.0:1788535760.016239:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569276672 00000100:00100000:0.0:1788535760.016622:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788535760.016632:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a7d8477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276672:12345-0@lo:502: 00000100:00100000:0.0:1788535760.016737:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a7d8477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276672:12345-0@lo:502: Request processed in 107us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535760.016743:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788535760.016835:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276672:0@lo:502: 00000040:00080000:3.0:1788535760.016884:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788535760.016892:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788535760.017773:0:7481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788535760.017799:0:7481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000023ac3c20) 00000020:00000080:2.0:1788535760.017818:0:7481:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788535760.017890:0:7481:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d517d674 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788535760.017894:0:7481:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d517d674 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788535760.017896:0:7481:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d517d674 3 00010000:00080000:2.0:1788535760.017932:0:7481:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003827fa80@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788535760.024892:0:7481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788535760.025196:0:7481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788535760.025250:0:7481:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788535760.025263:0:7481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe79af2f39bbdc116 00000100:00080000:2.0:1788535760.025274:0:7481:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788535760.025279:0:7481:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000003827fa80 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788535760.025314:0:7481:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002e4f039d x1875415569276800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788535760.025340:0:7481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788535760.025536:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e4f039d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875415569276800:0@lo:38: 00000100:00100000:1.0:1788535760.025610:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788535760.025977:0:7481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788535760.026025:0:7463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788535760.026055:0:7463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788535760.026068:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdc101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535760.026077:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000dda73ce3/0xe79af2f39bbdc101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788535760.026138:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788535760.026142:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788535760.026143:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788535760.026177:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788535760.026179:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788535760.026180:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788535760.026182:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788535760.026183:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788535760.026184:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788535760.026185:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788535760.026187:0:7463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788535760.026190:0:7463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788535760.026193:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788535760.026194:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788535760.026200:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788535760.026201:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788535760.026202:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788535760.026203:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788535760.026204:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788535760.026205:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788535760.026206:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788535760.026206:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788535760.026207:0:7463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 40000000:00080000:1.0:1788535760.026347:0:7482:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 10000000:01000000:3.0:1788535760.026503:0:7463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788535760.026516:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276928:0@lo:253: 00000100:00100000:3.0:1788535760.026558:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535760.026590:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000097ea4fc7 going to sleep for 11 seconds 00000100:00100000:2.0:1788535760.026810:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569276800 00000100:00100000:2.0:1788535760.026817:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569276800 00000100:00100000:2.0:1788535760.026853:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535760.026859:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c714aa55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1875415569276800:12345-0@lo:38: 00010000:00080000:2.0:1788535760.026881:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1788535760.026912:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe79af2f39bbdc11d 00000004:00100000:2.0:1788535760.026925:0:6533:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788535760.026965:0:6533:0:(import.c:65:import_set_state_nolock()) 0000000069942ce6 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788535760.027025:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c714aa55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875415569276800:12345-0@lo:38: Request processed in 165us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535760.027033:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788535760.027070:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002e4f039d x1875415569276800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788535770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535760.027082:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788535760.027089:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788535760.027094:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788535760.027098:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788535760.027100:0:3659:0:(import.c:65:import_set_state_nolock()) 000000003827fa80 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788535760.027105:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e4f039d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875415569276800:0@lo:38: 00000100:00100000:1.0:1788535760.027220:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569276928 00000100:00100000:1.0:1788535760.027224:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569276928 00000100:00100000:1.0:1788535760.027265:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788535760.027271:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f937c440 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276928:12345-0@lo:253: 20000000:01000000:1.0:1788535760.027288:0:6529:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788535760.027300:0:6529:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788535760.029706:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788535760.037599:0:6529:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788535760.037621:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788535760.038020:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f937c440 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:7463:x1875415569276928:12345-0@lo:253: Request processed in 10744us (11456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.038033:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 20000000:01000000:2.0:1788535760.038259:0:6549:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788535760.038264:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788535760.038283:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.038297:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc03d expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.038304:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc0de expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.038312:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.038346:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc0de expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.038360:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc0de expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535760.038387:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e4f039d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569277056:0@lo:104: 00000100:00100000:2.0:1788535760.038637:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788535760.038681:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc03d expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.038689:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc03d expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535760.038697:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001cf3bc35 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569277184:0@lo:104: 00000100:00100000:2.0:1788535760.038718:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535760.038738:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072a5d8fc going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.038785:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569277056 00000100:00100000:1.0:1788535760.038792:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569277056 00000100:00100000:1.0:1788535760.038818:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569277184 00000100:00100000:1.0:1788535760.038820:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569277184 00000100:00100000:1.0:1788535760.038831:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788535760.038837:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a78b0617 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:6549:x1875415569277056:12345-0@lo:104: 00010000:00010000:1.0:1788535760.038848:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.038898:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788535760.038903:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a78b0617 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:6549:x1875415569277056:12345-0@lo:104: Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.038909:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788535760.038923:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788535760.038928:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1d0001b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+3:6549:x1875415569277184:12345-0@lo:104: 00010000:00010000:1.0:1788535760.038935:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.038976:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788535760.038980:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1d0001b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+3:6549:x1875415569277184:12345-0@lo:104: Request processed in 53us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.038984:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788535760.038998:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788535760.039003:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039015:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000062c0f64d already unused, calling callback (00000000e83cffe2) 10000000:00010000:1.0:1788535760.039018:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039026:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535760.039031:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535760.039036:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535760.039061:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039202:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535760.039218:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039223:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 0000000062c0f64d/0xe79af2f39bbdc0de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc0ec expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039293:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535760.039295:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039301:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aaf4f903 already unused, calling callback (00000000e83cffe2) 10000000:00010000:1.0:1788535760.039303:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039319:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535760.039324:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535760.039328:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535760.039341:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039347:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535760.039359:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039365:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000aaf4f903/0xe79af2f39bbdc03d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc044 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535760.039376:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535760.039378:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535760.039379:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535760.039385:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535760.039395:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7fce117 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569277312:0@lo:103: 00000100:00100000:2.0:1788535760.039533:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e4f039d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569277056:0@lo:104: 00000100:00100000:2.0:1788535760.039542:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001cf3bc35 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569277184:0@lo:104: 00010000:00010000:2.0:1788535760.039559:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535760.039788:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535760.039864:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569277312 00000100:00100000:2.0:1788535760.039869:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569277312 00010000:00010000:2.0:1788535760.039887:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc0de expref: 15 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535760.039916:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788535760.039923:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8febab4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+15:3661:x1875415569277312:12345-0@lo:103: 00010000:00010000:2.0:1788535760.039933:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535760.039937:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc0de expref: 15 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.039969:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc0de expref: 15 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.039981:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000765892a2/0xe79af2f39bbdc0ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc0de expref: 15 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535760.039993:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535760.040022:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8febab4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+14:3661:x1875415569277312:12345-0@lo:103: Request processed in 100us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535760.040027:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788535760.040893:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7fce117 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569277312:0@lo:103: 00000100:00100000:3.0:1788535760.041530:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:7463:1875415569276928:0@lo:253: 10000000:01000000:3.0:1788535760.041544:0:7463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788535760.041547:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788535760.041548:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788535760.041550:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788535760.041551:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788535760.041552:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788535760.041553:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788535760.041554:0:7463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788535760.041555:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788535760.041556:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788535760.041558:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788535760.041559:0:7463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788535760.041570:0:7463:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788535760.048386:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535760.048414:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c49b4b5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569277440:0@lo:103: 00000100:00100000:2.0:1788535760.049373:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535760.049549:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569277440 00000100:00100000:0.0:1788535760.049558:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569277440 00010000:00010000:0.0:1788535760.049593:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc03d expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535760.049668:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788535760.049676:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bcaeea2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+14:3663:x1875415569277440:12345-0@lo:103: 00010000:00010000:0.0:1788535760.049689:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535760.049693:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc03d expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049704:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc03d expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049722:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074c85e85/0xe79af2f39bbdc044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc03d expref: 14 pid: 6526 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049738:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049747:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788535760.049766:0:6519:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011502205s 00010000:00010000:0.0:1788535760.049771:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049799:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049806:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049812:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049818:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004cdffccf already unused, calling callback (000000003d13c388) 00010000:00010000:0.0:1788535760.049821:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049828:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049846:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.049856:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535760.049889:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bcaeea2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+13:3663:x1875415569277440:12345-0@lo:103: Request processed in 215us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535760.049896:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535760.049983:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c49b4b5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569277440:0@lo:103: 00080000:10000000:3.0:1788535760.051116:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788535760.051329:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788535760.051543:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788535760.051705:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788535760.051880:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788535760.052061:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1788535760.052454:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535760.053603:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.053619:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535760.053626:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004cdffccf/0xe79af2f39bbdc124 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788535760.057669:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788535760.057967:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788535760.058586:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788535760.058756:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788535760.058932:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788535760.059544:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788535760.061724:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788535760.062004:0:7487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788535760.062068:0:7487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7487:1875415569277568:0@lo:700: 00000100:00100000:3.0:1788535760.062167:0:7487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535760.062273:0:7487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af01b755 going to sleep for 11 seconds 00000020:00080000:1.0:1788535760.065357:0:7486:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788535760.065366:0:7486:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788535760.066354:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788535760.066913:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4e16d47 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569277696:0@lo:1000: 00000100:00100000:0.0:1788535760.067012:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535760.067086:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fa57341 going to sleep for 11 seconds 00000040:01000000:3.0:1788535760.067687:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788535760.067807:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788535760.068311:0:7463:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788535760.068319:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788535760.068448:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788535760.069454:0:7463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788535760.070038:0:7463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788535760.070073:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788535760.070295:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788535760.070512:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1788535760.070756:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569277568 00000100:00100000:2.0:1788535760.070767:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569277568 00000100:00100000:2.0:1788535760.070963:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535760.070976:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007b2feb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7487:x1875415569277568:12345-0@lo:700: 00000100:00100000:1.0:1788535760.071224:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569277696 00000100:00100000:1.0:1788535760.071238:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569277696 00000100:00100000:1.0:1788535760.071283:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788535760.071290:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee1fca53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569277696:12345-0@lo:1000: 00000100:00100000:1.0:1788535760.071407:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee1fca53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569277696:12345-0@lo:1000: Request processed in 118us (4395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.071416:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535760.071673:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4e16d47 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569277696:0@lo:1000: 00000040:01000000:2.0:1788535760.071711:0:7488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788535760.071753:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001cf3bc35 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569277824:0@lo:700: 00000100:00100000:2.0:1788535760.071792:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535760.071825:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000079b8fdb6 going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.071888:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569277824 00000100:00100000:1.0:1788535760.071894:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569277824 00000100:00100000:1.0:1788535760.071926:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535760.071933:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e4f039d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569277824:12345-0@lo:700: 00000100:00100000:1.0:1788535760.071995:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e4f039d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569277824:12345-0@lo:700: Request processed in 63us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.072002:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788535760.072059:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001cf3bc35 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569277824:0@lo:700: 00000100:00100000:0.0:1788535760.072123:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0499622 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7488:1875415569277952:0@lo:900: 00000100:00100000:0.0:1788535760.072184:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535760.072198:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000159e51bf going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.072503:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569277952 00000100:00100000:1.0:1788535760.072508:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569277952 00000100:00100000:1.0:1788535760.072551:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788535760.072560:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000381123ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7488:x1875415569277952:12345-0@lo:900: 00000100:00100000:1.0:1788535760.072606:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000381123ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7488:x1875415569277952:12345-0@lo:900: Request processed in 49us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.072613:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788535760.072682:0:7488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b0499622 x1875415569277952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788535776 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535760.072693:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0499622 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7488:1875415569277952:0@lo:900: 00000100:00100000:0.0:1788535760.072770:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0499622 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569278080:0@lo:1000: 00000100:00100000:0.0:1788535760.072807:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535760.072862:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e014ab39 going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.072936:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569278080 00000100:00100000:1.0:1788535760.072939:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569278080 00000100:00100000:1.0:1788535760.073000:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788535760.073006:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f75a508 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569278080:12345-0@lo:1000: 00000100:00100000:1.0:1788535760.073256:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f75a508 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569278080:12345-0@lo:1000: Request processed in 250us (448us total) trans 0 rc 0/0 00100000:10000000:3.0:1788535760.073266:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:1.0:1788535760.073266:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535760.073366:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0499622 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569278080:0@lo:1000: 00000004:00080000:2.0:1788535760.073410:0:7488:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000159e51bf with version 0 00100000:10000000:3.0:1788535760.073426:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000020:00100000:2.0:1788535760.073570:0:7488:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788535760.073578:0:7488:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000bd6abeaf x1875415569278336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00100000:10000000:3.0:1788535760.073583:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000100:00100000:2.0:1788535760.073597:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd6abeaf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569278336:0@lo:1000: 00000100:00100000:2.0:1788535760.073634:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535760.073662:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000079b8fdb6 going to sleep for 11 seconds 00000100:00100000:0.0:1788535760.073728:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569278336 00000100:00100000:0.0:1788535760.073733:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569278336 00100000:10000000:3.0:1788535760.073743:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:0.0:1788535760.073760:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788535760.073768:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9b3438c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569278336:12345-0@lo:1000: 00100000:10000000:3.0:1788535760.074063:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788535760.075006:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788535760.075165:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788535760.075514:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788535760.075683:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788535760.075813:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788535760.075948:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788535760.077541:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788535760.077746:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788535760.077883:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788535760.078033:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000001:00080000:3.0:1788535760.079023:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:2.0:1788535760.079314:0:6540:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1788535760.080485:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9b3438c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569278336:12345-0@lo:1000: Request processed in 6645us (6779us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788535760.080516:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1788535760.080587:0:7488:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788535760.080592:0:7488:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788535760.080609:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd6abeaf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569278336:0@lo:1000: 00000100:00100000:1.0:1788535760.080693:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7fce117 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569278464:0@lo:1000: 00000100:00100000:1.0:1788535760.080733:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535760.080762:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569278464 00000100:00100000:1.0:1788535760.080769:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569278464 00000100:00100000:1.0:1788535760.080807:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788535760.080816:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b088eee5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569278464:12345-0@lo:1000: 00000100:00100000:1.0:1788535760.080876:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b088eee5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875415569278464:12345-0@lo:1000: Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535760.080882:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788535760.080917:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccacf09c going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.080929:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7fce117 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875415569278464:0@lo:1000: 00000040:00080000:1.0:1788535760.080947:0:7488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788535760.080987:0:7488:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003600dc7c with version 1 00000004:00080000:1.0:1788535760.081004:0:7478:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000001a3565f7 version 1 rpc_version 1 00000020:00100000:1.0:1788535760.081017:0:7478:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788535760.081024:0:7478:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a7fce117 x1875415569278720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788535760.081036:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7fce117 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7478:1875415569278720:0@lo:1000: 00000100:00100000:1.0:1788535760.081059:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535760.081072:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccacf09c going to sleep for 11 seconds 00000100:00100000:1.0:1788535760.081084:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569278720 00000100:00100000:1.0:1788535760.081087:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569278720 00100000:10000000:0.0:1788535760.081667:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788535760.082013:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:1.0:1788535760.083369:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788535760.083378:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d2485a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1875415569278720:12345-0@lo:1000: 00100000:10000000:0.0:1788535760.083710:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788535760.083890:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788535760.086719:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788535760.086910:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788535760.087136:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788535760.089759:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788535760.089943:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788535760.090101:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000040:00080000:1.0:1788535760.091856:0:7488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788535760.091971:0:7488:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1788535760.092288:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788535760.092504:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788535760.092675:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788535760.092813:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788535760.092964:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788535760.093099:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788535760.093277:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788535760.093470:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788535760.096381:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007b2feb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7487:x1875415569277568:12345-0@lo:700: Request processed in 25398us (34225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535760.096398:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788535760.096700:0:7487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000067b5c460 x1875415569277568/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788535776 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535760.096719:0:7487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7487:1875415569277568:0@lo:700: 40000000:02000000:3.0:1788535760.096743:0:7487:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1788535760.102869:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788535760.103321:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d2485a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1875415569278720:12345-0@lo:1000: Request processed in 19720us (22037us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788535760.103335:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788535760.103492:0:7478:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788535760.103499:0:7478:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788535760.103519:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7fce117 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7478:1875415569278720:0@lo:1000: 00000001:00080000:0.0:1788535760.106414:0:7463:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788535760.106541:0:7463:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa58c41703988 00100000:10000000:0.0:1788535760.106552:0:7463:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788535760.110918:0:7463:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788535760.110965:0:7463:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788535760.110985:0:7463:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788535760.111003:0:7463:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788535760.112209:0:7463:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788535760.112616:0:7463:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788535760.150501:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788535760.162098:0:7487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788535760.162192:0:7487:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788535760.162196:0:7487:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1788535761.080865:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535762.093387:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535763.117179:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535764.140499:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788535764.874676:0:7732:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788535765.165278:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535765.421321:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066070196 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569278848:0@lo:41: 00000100:00100000:2.0:1788535765.421390:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535765.421496:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569278848 00000100:00100000:1.0:1788535765.421504:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569278848 00000100:00100000:1.0:1788535765.421555:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535765.421563:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6abeaf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569278848:12345-0@lo:41: 00000004:00000024:1.0:1788535765.421597:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788535765.421644:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6abeaf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569278848:12345-0@lo:41: Request processed in 82us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535765.421651:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788535765.421728:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066070196 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569278848:0@lo:41: 00000100:00100000:2.0:1788535765.422699:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000081757850 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569279104:0@lo:400: 00000100:00100000:2.0:1788535765.422749:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535765.422778:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535765.422784:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001cf3bc35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569278976:0@lo:400: 00000100:00100000:2.0:1788535765.422808:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535765.422936:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569279104 00000100:00100000:2.0:1788535765.422943:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569279104 00000100:00100000:2.0:1788535765.422979:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535765.422993:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddafa11e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569279104:12345-0@lo:400: 00000100:00100000:2.0:1788535765.423034:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddafa11e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569279104:12345-0@lo:400: Request processed in 44us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535765.423041:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535765.423062:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ec853ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569279232:0@lo:400: 00000100:00100000:2.0:1788535765.423098:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535765.423130:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569279232 00000100:00100000:2.0:1788535765.423133:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569279232 00000100:00100000:2.0:1788535765.423179:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788535765.423185:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f89eec01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569279232:12345-0@lo:400: 00000100:00100000:2.0:1788535765.423216:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f89eec01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569279232:12345-0@lo:400: Request processed in 32us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535765.423223:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788535765.423250:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001ec853ab x1875415569279232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535765.423263:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ec853ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569279232:0@lo:400: 00010000:00080000:2.0:1788535765.423287:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000081757850 x1875415569279104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535765.423296:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000081757850 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569279104:0@lo:400: 00000100:00100000:3.0:1788535765.426703:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569278976 00000100:00100000:3.0:1788535765.426718:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569278976 00000100:00100000:3.0:1788535765.426856:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788535765.426866:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cb4008b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+13:3661:x1875415569278976:12345-0@lo:400: 00000100:00100000:3.0:1788535765.426976:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cb4008b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+13:3661:x1875415569278976:12345-0@lo:400: Request processed in 111us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535765.427134:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788535765.427677:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001cf3bc35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569278976:0@lo:400: 00000020:00000004:3.0:1788535765.759632:0:7784:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788535765.759839:0:7784:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788535766.188780:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535767.212429:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535768.241129:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788535768.631528:0:7886:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788535768.631790:0:7886:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788535769.261303:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788535769.770453:0:7934:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedbfdf1f0 20000000:00000080:0.0:1788535769.770473:0:7934:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90059e0cd000 uarg=0000000000000000 20000000:01000000:0.0:1788535769.770555:0:7934:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788535769.770563:0:7934:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788535769.770567:0:7934:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788535769.770636:0:7934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788535769.770647:0:7934:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788535769.776242:0:7934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788535769.776490:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788535769.776679:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788535769.776699:0:7934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788535769.776715:0:7934:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788535769.776734:0:7934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.776751:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc005 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.776758:0:7934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc0f3 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.776764:0:7934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.776801:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc0f3 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.776825:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc0f3 expref: 12 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535769.776840:0:7934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abcf295a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7934:1875415569279360:0@lo:104: 00000100:00100000:0.0:1788535769.776924:0:7934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535769.776988:0:7934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc005 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535769.779497:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788535769.779542:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569279360 00000100:00100000:2.0:1788535769.779551:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569279360 00000100:00100000:2.0:1788535769.779611:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788535769.779619:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000370ef95e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:7934:x1875415569279360:12345-0@lo:104: 00010000:00010000:2.0:1788535769.779653:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.779742:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535769.779748:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000370ef95e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:7934:x1875415569279360:12345-0@lo:104: Request processed in 130us (2825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535769.779755:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788535769.779797:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535769.779802:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.779810:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe24b14a already unused, calling callback (00000000e83cffe2) 10000000:00010000:2.0:1788535769.779814:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.779821:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535769.779828:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535769.779833:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788535769.779864:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.779870:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535769.779899:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.779905:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000fe24b14a/0xe79af2f39bbdc0f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc0fa expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.779924:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535769.779926:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535769.779927:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535769.779948:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8ed2633 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569279616:0@lo:103: 00000100:00100000:2.0:1788535769.779979:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.780241:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569279616 00000100:00100000:2.0:1788535769.780247:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569279616 00010000:00010000:2.0:1788535769.780267:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc0f3 expref: 13 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.780362:0:7934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc005 expref: 13 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535769.780377:0:7934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae09f35e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7934:1875415569279488:0@lo:104: 00000100:00100000:0.0:1788535769.780407:0:7934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535769.780430:0:7934:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9b3332 going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.780450:0:7934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abcf295a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7934:1875415569279360:0@lo:104: 00000100:00100000:2.0:1788535769.784569:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788535769.784595:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a78b0617 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+13:3663:x1875415569279616:12345-0@lo:103: 00010000:00010000:2.0:1788535769.784619:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535769.784628:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc0f3 expref: 13 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.784644:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc0f3 expref: 13 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.784663:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000059fd352/0xe79af2f39bbdc0fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc0f3 expref: 13 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.784679:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535769.784761:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a78b0617 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+12:3663:x1875415569279616:12345-0@lo:103: Request processed in 178us (4781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535769.784768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788535769.784906:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8ed2633 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569279616:0@lo:103: 00000100:00100000:0.0:1788535769.784974:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569279488 00000100:00100000:0.0:1788535769.784981:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569279488 00000100:00100000:0.0:1788535769.785032:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788535769.785038:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000268fb4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:7934:x1875415569279488:12345-0@lo:104: 00010000:00010000:0.0:1788535769.785050:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.785097:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788535769.785102:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000268fb4ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:7934:x1875415569279488:12345-0@lo:104: Request processed in 65us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.785107:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788535769.785226:0:7934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae09f35e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7934:1875415569279488:0@lo:104: 00010000:00010000:0.0:1788535769.785245:0:7934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.785280:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535769.785286:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.785293:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d9b388f0 already unused, calling callback (00000000e83cffe2) 10000000:00010000:0.0:1788535769.785297:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.785304:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535769.785309:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535769.785314:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788535769.785344:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.785351:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535769.785368:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.785373:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000d9b388f0/0xe79af2f39bbdc005 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc00c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.785386:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535769.785388:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535769.785394:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535769.785412:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae09f35e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569279744:0@lo:103: 00000100:00100000:0.0:1788535769.785448:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.791099:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569279744 00000100:00100000:1.0:1788535769.791114:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569279744 00010000:00010000:1.0:1788535769.791229:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc005 expref: 12 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535769.791304:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535769.791313:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abcf295a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+12:3660:x1875415569279744:12345-0@lo:103: 00010000:00010000:1.0:1788535769.791340:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535769.791345:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc005 expref: 12 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791356:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc005 expref: 12 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791373:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000abae60b1/0xe79af2f39bbdc00c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc005 expref: 12 pid: 6529 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791387:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791394:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791410:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791416:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791422:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791428:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791434:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fc0aecc5 already unused, calling callback (000000003d13c388) 00010000:00010000:1.0:1788535769.791438:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791455:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791478:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.791489:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535769.791525:0:7934:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.791536:0:7934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.791541:0:7934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc0aecc5/0xe79af2f39bbdc12b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535769.791671:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abcf295a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+11:3660:x1875415569279744:12345-0@lo:103: Request processed in 359us (6222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.791680:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535769.791720:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae09f35e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569279744:0@lo:103: 10000000:01000000:3.0:1788535769.795243:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788535769.795250:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9005831a8000 from 4 10000000:01000000:3.0:1788535769.795254:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788535769.795292:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000046b200fa/0xe79af2f39bbdc132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.795310:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000046b200fa/0xe79af2f39bbdc132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.795334:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000046b200fa/0xe79af2f39bbdc132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535769.795358:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569279872:0@lo:101: 00000100:00100000:3.0:1788535769.795420:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535769.795504:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af01b755 going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.800708:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569279872 00000100:00100000:0.0:1788535769.800723:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569279872 00000100:00100000:1.0:1788535769.800833:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788535769.800843:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001047b40a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+11:6531:x1875415569279872:12345-0@lo:101: 00010000:00010000:1.0:1788535769.800861:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535769.800879:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f785d7cc/0xe79af2f39bbdc139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc132 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.800915:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f785d7cc/0xe79af2f39bbdc139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc132 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.800926:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f785d7cc/0xe79af2f39bbdc139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc132 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.800935:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f785d7cc, rc 0) 00000100:00100000:1.0:1788535769.801064:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001047b40a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+12:6531:x1875415569279872:12345-0@lo:101: Request processed in 223us (5644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.801072:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788535769.801128:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569279872:0@lo:101: 00010000:00010000:3.0:1788535769.801183:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000046b200fa/0xe79af2f39bbdc132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.801195:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000046b200fa/0xe79af2f39bbdc132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535769.801663:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280000:0@lo:256: 00000100:00100000:2.0:1788535769.801720:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.801757:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000159e51bf going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.801823:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569280000 00000100:00100000:0.0:1788535769.801829:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569280000 00000100:00100000:0.0:1788535769.801868:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788535769.801875:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f3c8ae9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:6531:x1875415569280000:12345-0@lo:256: 20000000:01000000:0.0:1788535769.801903:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788535769.801919:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788535769.801923:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788535769.802008:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f3c8ae9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:6531:x1875415569280000:12345-0@lo:256: Request processed in 133us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.802014:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788535769.802415:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067b5c460 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280000:0@lo:256: 10000000:01000000:2.0:1788535769.802465:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788535769.802472:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000046b200fa/0xe79af2f39bbdc132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.802482:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000046b200fa/0xe79af2f39bbdc132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535769.802492:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788535769.802494:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831a8000 from 1 10000000:01000000:2.0:1788535769.802497:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788535769.802536:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdc140 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.802543:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdc140 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.802551:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdc140 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535769.802566:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1d0001b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280128:0@lo:101: 00000100:00100000:2.0:1788535769.802598:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.802635:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076229ec9 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.812841:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569280128 00000100:00100000:1.0:1788535769.812855:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569280128 00000100:00100000:1.0:1788535769.812929:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788535769.812940:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b86df56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+12:6531:x1875415569280128:12345-0@lo:101: 00010000:00010000:1.0:1788535769.812958:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535769.812976:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa59bdd9/0xe79af2f39bbdc147 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc140 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.813001:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa59bdd9/0xe79af2f39bbdc147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc140 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.813013:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa59bdd9/0xe79af2f39bbdc147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc140 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.813021:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa59bdd9, rc 0) 00000100:00100000:1.0:1788535769.813102:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b86df56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+13:6531:x1875415569280128:12345-0@lo:101: Request processed in 165us (10504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.813109:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788535769.813218:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1d0001b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280128:0@lo:101: 00010000:00010000:3.0:1788535769.813239:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdc140 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.813249:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000004cdffccf/0xe79af2f39bbdc140 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535769.813328:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f43f4a95 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280256:0@lo:501: 00000100:00100000:3.0:1788535769.813367:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535769.813405:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af01b755 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.814687:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569280256 00000100:00100000:1.0:1788535769.814698:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569280256 00000100:00100000:1.0:1788535769.815795:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788535769.815809:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016248844 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+13:6531:x1875415569280256:12345-0@lo:501: 00000100:00100000:1.0:1788535769.815983:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016248844 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+13:6531:x1875415569280256:12345-0@lo:501: Request processed in 178us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.815991:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788535769.816130:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f43f4a95 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280256:0@lo:501: 00000100:00100000:3.0:1788535769.816280:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f43f4a95 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280384:0@lo:503: 00000100:00100000:3.0:1788535769.817495:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535769.817547:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af01b755 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.817676:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569280384 00000100:00100000:1.0:1788535769.817683:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569280384 00000100:00100000:1.0:1788535769.817733:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788535769.817741:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5113092 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+13:6531:x1875415569280384:12345-0@lo:503: 00000100:00100000:1.0:1788535769.817874:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5113092 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+13:6531:x1875415569280384:12345-0@lo:503: Request processed in 133us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.817881:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788535769.819435:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f43f4a95 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280384:0@lo:503: 00000100:00100000:2.0:1788535769.824353:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001cf3bc35 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7936:1875415569280512:0@lo:502: 00000100:00100000:2.0:1788535769.824478:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.824514:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569280512 00000100:00100000:2.0:1788535769.824520:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569280512 00000100:00100000:2.0:1788535769.824555:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788535769.824562:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a2ceafb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+13:7936:x1875415569280512:12345-0@lo:502: 00000100:00100000:2.0:1788535769.824682:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a2ceafb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+13:7936:x1875415569280512:12345-0@lo:502: Request processed in 121us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535769.824690:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788535769.824740:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set 000000001697dbe8 going to sleep for 11 seconds 00000100:00100000:2.0:1788535769.824763:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001cf3bc35 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7936:1875415569280512:0@lo:502: 00000020:01000000:2.0:1788535769.824791:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535769.824801:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535769.824804:0:7936:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788535769.824811:0:7936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9005831a8000 00000020:00000080:2.0:1788535769.824814:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788535769.824852:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7936:1875415569280640:0@lo:502: 00000100:00100000:2.0:1788535769.824954:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.824978:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135540 going to sleep for 11 seconds 00000100:00100000:3.0:1788535769.825251:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569280640 00000100:00100000:3.0:1788535769.825257:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569280640 00000100:00100000:3.0:1788535769.825336:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788535769.825344:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+13:7936:x1875415569280640:12345-0@lo:502: 00000100:00100000:3.0:1788535769.825437:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+13:7936:x1875415569280640:12345-0@lo:502: Request processed in 94us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535769.825444:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788535769.825503:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7936:1875415569280640:0@lo:502: 00000020:01000000:2.0:1788535769.825524:0:7936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535769.825528:0:7936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535769.825530:0:7936:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788535769.825534:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788535769.825594:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788535769.825619:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788535769.825629:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.825640:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535769.825659:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788535769.825661:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005831fb800 from 21 10000000:01000000:2.0:1788535769.825664:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788535769.825689:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.825697:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.825706:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535769.825720:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280768:0@lo:101: 00000100:00100000:2.0:1788535769.825749:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.831932:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1ba240 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.832082:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569280768 00000100:00100000:1.0:1788535769.832092:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569280768 00000100:00100000:1.0:1788535769.832575:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788535769.832585:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+13:6531:x1875415569280768:12345-0@lo:101: 00010000:00010000:1.0:1788535769.832601:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535769.832618:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc14e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.832651:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc14e expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.832662:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc14e expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.832671:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51600, rc 0) 00000100:00100000:1.0:1788535769.832736:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:6531:x1875415569280768:12345-0@lo:101: Request processed in 152us (6986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.832743:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788535769.832784:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280768:0@lo:101: 00010000:00010000:1.0:1788535769.832803:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.832812:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535769.832911:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280896:0@lo:501: 00000100:00100000:1.0:1788535769.832945:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.832955:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.832975:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569280896 00000100:00100000:1.0:1788535769.832979:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569280896 00000100:00100000:1.0:1788535769.832995:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788535769.833001:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:6531:x1875415569280896:12345-0@lo:501: 00000100:00100000:1.0:1788535769.833113:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:6531:x1875415569280896:12345-0@lo:501: Request processed in 111us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.833120:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788535769.833143:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569280896:0@lo:501: 00000100:00100000:1.0:1788535769.833188:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281024:0@lo:503: 00000100:00100000:1.0:1788535769.833225:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.833234:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.833249:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569281024 00000100:00100000:1.0:1788535769.833253:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569281024 00000100:00100000:1.0:1788535769.833269:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788535769.833274:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:6531:x1875415569281024:12345-0@lo:503: 00000100:00100000:1.0:1788535769.833349:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:6531:x1875415569281024:12345-0@lo:503: Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.833355:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788535769.833385:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281024:0@lo:503: 00000100:00100000:1.0:1788535769.840370:0:7938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7938:1875415569281152:0@lo:502: 00000100:00100000:1.0:1788535769.840453:0:7938:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.840508:0:7938:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535769.841257:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569281152 00000100:00100000:3.0:1788535769.841266:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569281152 00000100:00100000:3.0:1788535769.841308:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788535769.841329:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:7938:x1875415569281152:12345-0@lo:502: 00000100:00100000:3.0:1788535769.841472:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:7938:x1875415569281152:12345-0@lo:502: Request processed in 156us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535769.841479:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788535769.841663:0:7938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7938:1875415569281152:0@lo:502: 00000100:00100000:1.0:1788535769.841722:0:7938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7938:1875415569281280:0@lo:502: 00000100:00100000:1.0:1788535769.841760:0:7938:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.841785:0:7938:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535769.841948:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569281280 00000100:00100000:3.0:1788535769.841953:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569281280 00000100:00100000:3.0:1788535769.841984:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788535769.841990:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:7938:x1875415569281280:12345-0@lo:502: 00000100:00100000:3.0:1788535769.842049:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:7938:x1875415569281280:12345-0@lo:502: Request processed in 59us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535769.842056:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788535769.842671:0:7938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7938:1875415569281280:0@lo:502: 00000040:00080000:1.0:1788535769.842696:0:7938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788535769.843592:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788535769.843621:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788535769.843633:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.843645:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535769.843655:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788535769.843657:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9005831fb800 from 4 10000000:01000000:0.0:1788535769.843660:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788535769.843694:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.843702:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.843720:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535769.843738:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281408:0@lo:101: 00000100:00100000:0.0:1788535769.843791:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535769.843833:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900588f74600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535769.843940:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569281408 00000100:00100000:3.0:1788535769.843947:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569281408 00000100:00100000:3.0:1788535769.844622:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535769.844642:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+14:6531:x1875415569281408:12345-0@lo:101: 00010000:00010000:3.0:1788535769.844655:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535769.844669:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc15c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.844692:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc15c expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.844703:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc15c expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.844711:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3fa00, rc 0) 00000100:00100000:3.0:1788535769.848497:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569281408:12345-0@lo:101: Request processed in 3848us (4695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535769.848510:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788535769.853399:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281408:0@lo:101: 00010000:00010000:2.0:1788535769.853429:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.853442:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535769.853506:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281536:0@lo:256: 00000100:00100000:2.0:1788535769.853568:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.853605:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1ba240 going to sleep for 11 seconds 00000100:00100000:2.0:1788535769.853624:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569281536 00000100:00100000:2.0:1788535769.853629:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569281536 00000100:00100000:2.0:1788535769.853667:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788535769.853680:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569281536:12345-0@lo:256: 20000000:01000000:2.0:1788535769.853699:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788535769.853710:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788535769.853714:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788535769.853779:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569281536:12345-0@lo:256: Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535769.853786:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788535769.856242:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281536:0@lo:256: 10000000:01000000:2.0:1788535769.856309:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788535769.856388:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.856400:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535769.856410:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788535769.856412:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788535769.856415:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788535769.856453:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.856462:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.856473:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535769.856495:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281664:0@lo:101: 00000100:00100000:2.0:1788535769.856564:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.856630:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135540 going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.856700:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569281664 00000100:00100000:0.0:1788535769.856708:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569281664 00000100:00100000:0.0:1788535769.856763:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788535769.856773:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569281664:12345-0@lo:101: 00010000:00010000:0.0:1788535769.856786:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535769.856800:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc16a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.856824:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc16a expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.856835:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc16a expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.856844:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030c00, rc 0) 00000100:00100000:0.0:1788535769.857730:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569281664:12345-0@lo:101: Request processed in 953us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.857741:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788535769.858123:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281664:0@lo:101: 00010000:00010000:2.0:1788535769.858141:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535769.858269:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535769.858351:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281792:0@lo:501: 00000100:00100000:2.0:1788535769.858391:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.858418:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135540 going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.858765:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569281792 00000100:00100000:0.0:1788535769.858773:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569281792 00000100:00100000:0.0:1788535769.858818:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788535769.858827:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569281792:12345-0@lo:501: 00000100:00100000:0.0:1788535769.859054:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569281792:12345-0@lo:501: Request processed in 227us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.859061:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788535769.859115:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281792:0@lo:501: 00000100:00100000:1.0:1788535769.859183:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281920:0@lo:503: 00000100:00100000:1.0:1788535769.859226:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.859254:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.859323:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569281920 00000100:00100000:0.0:1788535769.859328:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569281920 00000100:00100000:0.0:1788535769.860027:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788535769.860038:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569281920:12345-0@lo:503: 00000100:00100000:0.0:1788535769.860171:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569281920:12345-0@lo:503: Request processed in 110us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.860179:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788535769.862370:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569281920:0@lo:503: 00000100:00100000:1.0:1788535769.862872:0:7940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7940:1875415569282048:0@lo:502: 00000100:00100000:1.0:1788535769.862967:0:7940:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.863002:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569282048 00000100:00100000:1.0:1788535769.863009:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569282048 00000100:00100000:1.0:1788535769.863042:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788535769.863050:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:7940:x1875415569282048:12345-0@lo:502: 00000100:00100000:1.0:1788535769.863470:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:7940:x1875415569282048:12345-0@lo:502: Request processed in 419us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.863478:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788535769.863733:0:7940:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.863754:0:7940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7940:1875415569282048:0@lo:502: 00000020:01000000:1.0:1788535769.863780:0:7940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535769.863809:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535769.863812:0:7940:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788535769.863819:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788535769.863823:0:7940:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:00000080:1.0:1788535769.863845:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788535769.863860:0:7940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9005baf28000) 00000020:00000080:1.0:1788535769.863879:0:7940:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788535769.863894:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788535769.864134:0:7940:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788535769.864141:0:7940:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788535769.864172:0:7940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdc17f 00010000:00080000:1.0:1788535769.864342:0:7940:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9005893a7800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788535769.867143:0:7940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788535769.868946:0:7940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788535769.868962:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788535769.869001:0:7940:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788535769.869024:0:7940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdc186 00000100:00080000:1.0:1788535769.869035:0:7940:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788535769.869040:0:7940:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9005893a7800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788535769.869082:0:7940:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059e019c00 x1875415569282176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788535769.869102:0:7940:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788535769.869183:0:7940:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788535769.869428:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569282432:0@lo:400: 00000100:00100000:0.0:1788535769.869476:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535769.869504:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535769.869510:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569282560:0@lo:400: 00000100:00100000:0.0:1788535769.869536:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.869570:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535769.869579:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569282304:0@lo:400: 00000100:00100000:0.0:1788535769.869579:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569282560 00000100:00100000:0.0:1788535769.869585:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569282560 00000100:00100000:1.0:1788535769.869604:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535769.869624:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788535769.869631:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569282560:12345-0@lo:400: 00000100:00100000:0.0:1788535769.869677:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569282560:12345-0@lo:400: Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.869684:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788535769.869767:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569282432 00000100:00100000:1.0:1788535769.869771:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569282432 00000100:00100000:1.0:1788535769.869810:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788535769.869816:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569282432:12345-0@lo:400: 00000100:00100000:1.0:1788535769.869853:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569282432:12345-0@lo:400: Request processed in 37us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.869858:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788535769.869874:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569282304 00000100:00100000:1.0:1788535769.869877:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569282304 00000100:00100000:1.0:1788535769.869910:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788535769.869916:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569282304:12345-0@lo:400: 00000100:00100000:1.0:1788535769.869946:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569282304:12345-0@lo:400: Request processed in 30us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.869951:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788535769.869984:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9005842e6d80 x1875415569282304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535769.869996:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569282304:0@lo:400: 00010000:00080000:0.0:1788535769.870211:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9005842e5880 x1875415569282560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535769.870220:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569282560:0@lo:400: 00000100:00100000:0.0:1788535769.870236:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569282432:0@lo:400: 00000100:00100000:2.0:1788535769.870267:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569282176:0@lo:38: 00000100:00100000:2.0:1788535769.870307:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.870359:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569282176 00000100:00100000:1.0:1788535769.870363:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569282176 00000100:00100000:1.0:1788535769.870382:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788535769.870386:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569282176:12345-0@lo:38: 00010000:00080000:1.0:1788535769.870406:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1788535769.870435:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdc18d 00000004:00100000:1.0:1788535769.870450:0:6538:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788535769.870455:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788535769.871355:0:7943:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9005894aca80 x1875415569282688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535769.871367:0:7943:0:(client.c:2716:ptlrpc_set_wait()) set ffff900591d05f00 going to sleep for 0 seconds 00000020:01000000:0.0:1788535769.871531:0:7940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535769.871537:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535769.871540:0:7940:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788535769.871544:0:7940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535769.871548:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535769.871550:0:7940:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788535769.871553:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788535769.871554:0:7940:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788535769.871580:0:7940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7940:1875415569282816:0@lo:502: 00000100:00100000:0.0:1788535769.871640:0:7940:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535769.871678:0:7940:0:(client.c:2716:ptlrpc_set_wait()) set ffff900588f749c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.872666:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569282816 00000100:00100000:1.0:1788535769.872675:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569282816 00000100:00100000:1.0:1788535769.872717:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788535769.872726:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:7940:x1875415569282816:12345-0@lo:502: 00000100:00100000:1.0:1788535769.872856:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:7940:x1875415569282816:12345-0@lo:502: Request processed in 130us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.872878:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788535769.872941:0:7940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7940:1875415569282816:0@lo:502: 00000020:01000000:1.0:1788535769.872966:0:7940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535769.872972:0:7940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535769.872975:0:7940:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788535769.872978:0:7940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788535769.873050:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788535769.873070:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788535769.873079:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.873089:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535769.873098:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788535769.873101:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831fb800 from 1 10000000:01000000:1.0:1788535769.873104:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788535769.873129:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.873136:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.873173:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535769.873190:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569282944:0@lo:101: 00000100:00100000:1.0:1788535769.873222:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.873246:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900586422240 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.873265:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569282944 00000100:00100000:1.0:1788535769.873269:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569282944 00000100:00100000:1.0:1788535769.873290:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788535769.873296:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569282944:12345-0@lo:101: 00010000:00010000:1.0:1788535769.873304:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535769.873328:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc194 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.873351:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc194 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.873361:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc194 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.873369:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51200, rc 0) 00000100:00100000:1.0:1788535769.873398:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569282944:12345-0@lo:101: Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.873404:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788535769.873433:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569282944:0@lo:101: 00010000:00010000:1.0:1788535769.873446:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535769.873454:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535769.873499:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569283072:0@lo:501: 00000100:00100000:1.0:1788535769.873523:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.873535:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900586422240 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.873545:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569283072 00000100:00100000:1.0:1788535769.873555:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569283072 00000100:00100000:1.0:1788535769.873577:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788535769.873583:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569283072:12345-0@lo:501: 00000100:00100000:1.0:1788535769.873669:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569283072:12345-0@lo:501: Request processed in 85us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.873675:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788535769.873703:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569283072:0@lo:501: 00000100:00100000:1.0:1788535769.873726:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569283200:0@lo:503: 00000100:00100000:1.0:1788535769.873756:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.873767:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900586422240 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.873776:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569283200 00000100:00100000:1.0:1788535769.873779:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569283200 00000100:00100000:1.0:1788535769.873799:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788535769.873803:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569283200:12345-0@lo:503: 00000100:00100000:1.0:1788535769.873861:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569283200:12345-0@lo:503: Request processed in 56us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.873867:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788535769.873913:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569283200:0@lo:503: 00000100:00100000:3.0:1788535769.885043:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7944:1875415569283328:0@lo:502: 00000100:00100000:3.0:1788535769.885140:0:7944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535769.885487:0:7944:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac8639c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788535769.896134:0:6538:0:(import.c:65:import_set_state_nolock()) ffff9005842eb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535769.896597:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1875415569282176:12345-0@lo:38: Request processed in 26206us (26286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.896609:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788535769.899489:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569283328 00000100:00100000:2.0:1788535769.899507:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569283328 00000100:00100000:2.0:1788535769.901190:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788535769.901203:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:7944:x1875415569283328:12345-0@lo:502: 00000100:00100000:2.0:1788535769.901482:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:7944:x1875415569283328:12345-0@lo:502: Request processed in 281us (16341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535769.901490:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788535769.901580:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7944:1875415569283328:0@lo:502: 00000020:01000000:0.0:1788535769.901613:0:7944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535769.901622:0:7944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535769.901624:0:7944:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788535769.901631:0:7944:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9005831fb800 00000020:00000080:0.0:1788535769.901634:0:7944:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788535769.901669:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7944:1875415569283456:0@lo:502: 00000100:00100000:0.0:1788535769.901712:0:7944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535769.901747:0:7944:0:(client.c:2716:ptlrpc_set_wait()) set ffff900588f749c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535769.903261:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569283456 00000100:00100000:2.0:1788535769.903278:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569283456 00000100:00100000:2.0:1788535769.903338:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788535769.903347:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:7944:x1875415569283456:12345-0@lo:502: 00000100:00100000:2.0:1788535769.903500:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:7944:x1875415569283456:12345-0@lo:502: Request processed in 152us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535769.903509:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788535769.903663:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788535769.903675:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788535769.903682:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788535769.903688:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788535769.903693:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005893a7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788535769.903711:0:3659:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009383457e): req@ffff9005894aca80 x1875415569282688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535769.903727:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569282176:0@lo:38: 00000100:00100000:0.0:1788535769.904174:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:7944:1875415569283456:0@lo:502: 00000020:01000000:0.0:1788535769.904201:0:7944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535769.904208:0:7944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535769.904210:0:7944:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788535769.904213:0:7944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788535769.904445:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788535769.904470:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535769.904479:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.904489:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535769.904497:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788535769.904500:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9005baf299c0 from 1 10000000:01000000:3.0:1788535769.904503:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788535769.904527:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.904533:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535769.904542:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535769.904630:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569283712:0@lo:101: 00000100:00100000:3.0:1788535769.904682:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.904697:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569283584:0@lo:41: 00000100:00100000:3.0:1788535769.904718:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac863600 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.904739:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.904788:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569283584 00000100:00100000:1.0:1788535769.904793:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569283584 00000100:00100000:2.0:1788535769.904954:0:7943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.904980:0:7943:0:(client.c:2716:ptlrpc_set_wait()) set ffff900591d05f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535769.905083:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569282688 00000100:00100000:1.0:1788535769.905087:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569282688 00000100:00100000:1.0:1788535769.905102:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788535769.905108:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569283584:12345-0@lo:41: 00000004:00000024:1.0:1788535769.905266:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788535769.905361:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569283584:12345-0@lo:41: Request processed in 252us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.905369:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788535769.905384:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788535769.905391:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7943:x1875415569282688:12345-0@lo:1000: 00000100:00100000:1.0:1788535769.905444:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7943:x1875415569282688:12345-0@lo:1000: Request processed in 55us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535769.905450:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788535769.906506:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569283712 00000100:00100000:0.0:1788535769.906516:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569283712 00000100:00100000:0.0:1788535769.906564:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788535769.906572:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569283712:12345-0@lo:101: 00010000:00010000:0.0:1788535769.906584:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535769.906601:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc1a2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.906624:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1a2 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.906635:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1a2 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.906643:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030600, rc 0) 00000100:00100000:0.0:1788535769.906694:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569283712:12345-0@lo:101: Request processed in 123us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.906701:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788535769.906747:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569283712:0@lo:101: 00010000:00010000:0.0:1788535769.906764:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.906773:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535769.906856:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569283840:0@lo:501: 00000100:00100000:0.0:1788535769.906895:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535769.906923:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900588f74e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.906937:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569283840 00000100:00100000:0.0:1788535769.906953:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569283840 00000100:00100000:0.0:1788535769.906977:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788535769.906983:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569283840:12345-0@lo:501: 00000100:00100000:0.0:1788535769.907060:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569283840:12345-0@lo:501: Request processed in 77us (164us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788535769.907066:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788535769.907094:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569283840:0@lo:501: 10000000:01000000:0.0:1788535769.907120:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788535769.907127:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535769.907135:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535769.909302:0:7943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569282688:0@lo:1000: 00000040:01000000:3.0:1788535769.909356:0:7943:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788535769.909403:0:7943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569283968:0@lo:1000: 00000100:00100000:3.0:1788535769.909460:0:7943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535769.909505:0:7943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac8633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.909627:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569283968 00000100:00100000:0.0:1788535769.909633:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569283968 00000100:00100000:0.0:1788535769.909679:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788535769.909688:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7943:x1875415569283968:12345-0@lo:1000: 00000100:00100000:0.0:1788535769.909805:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7943:x1875415569283968:12345-0@lo:1000: Request processed in 119us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.909959:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788535769.910023:0:7943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569283968:0@lo:1000: 00000100:00100000:3.0:1788535769.910060:0:7943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569284096:0@lo:700: 00000100:00100000:3.0:1788535769.910094:0:7943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535769.910117:0:7943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac863c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.910440:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569284096 00000100:00100000:0.0:1788535769.910446:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569284096 00000100:00100000:0.0:1788535769.910480:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788535769.910487:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7943:x1875415569284096:12345-0@lo:700: 00000100:00100000:0.0:1788535769.910531:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7943:x1875415569284096:12345-0@lo:700: Request processed in 44us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.910537:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535769.911610:0:7943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569284096:0@lo:700: 00000100:00100000:3.0:1788535769.911805:0:7943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569284224:0@lo:1000: 00000100:00100000:3.0:1788535769.911860:0:7943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535769.911891:0:7943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac863b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535769.912965:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569284224 00000100:00100000:0.0:1788535769.912975:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569284224 00000100:00100000:0.0:1788535769.913034:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788535769.913043:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7943:x1875415569284224:12345-0@lo:1000: 00000100:00100000:0.0:1788535769.913141:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7943:x1875415569284224:12345-0@lo:1000: Request processed in 99us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535769.913169:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788535769.913472:0:7943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569284224:0@lo:1000: 00000004:00080000:3.0:1788535769.913539:0:7943:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9005ac863c00 with version 0 00000020:00100000:3.0:1788535769.913560:0:7943:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788535769.913568:0:7943:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9005842e3b80 x1875415569284480/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788535769.913585:0:7943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569284480:0@lo:1000: 00000100:00100000:3.0:1788535769.913617:0:7943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535769.913644:0:7943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac863180 going to sleep for 11 seconds 00000100:00100000:2.0:1788535769.914896:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569283584:0@lo:41: 00000100:00100000:0.0:1788535769.915357:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569284480 00000100:00100000:0.0:1788535769.915365:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569284480 00000100:00100000:0.0:1788535769.915421:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788535769.915430:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7943:x1875415569284480:12345-0@lo:1000: 00000001:00080000:2.0:1788535769.923460:0:7464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1788535769.923476:0:7464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788535769.923913:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7943:x1875415569284480:12345-0@lo:1000: Request processed in 8478us (10289us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788535769.923926:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1788535769.924116:0:7943:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788535769.924121:0:7943:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788535769.924140:0:7943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569284480:0@lo:1000: 00000100:00100000:1.0:1788535769.924488:0:7943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569284608:0@lo:1000: 00000100:00100000:1.0:1788535769.924539:0:7943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535769.924618:0:7943:0:(client.c:2716:ptlrpc_set_wait()) set ffff900582eb1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535769.931424:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569284608 00000100:00100000:2.0:1788535769.931440:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569284608 00000100:00100000:2.0:1788535769.931500:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788535769.931509:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7943:x1875415569284608:12345-0@lo:1000: 00000100:00100000:2.0:1788535769.931637:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7943:x1875415569284608:12345-0@lo:1000: Request processed in 129us (7097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535769.931645:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788535769.932053:0:7943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7943:1875415569284608:0@lo:1000: 00000040:00080000:1.0:1788535769.932080:0:7943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788535769.932119:0:7943:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff900582eb1a80 with version 1 00000004:00080000:2.0:1788535769.933267:0:7941:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff90058934ff00 version 1 rpc_version 1 00000020:00100000:2.0:1788535769.933301:0:7941:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788535769.933311:0:7941:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9005894ace00 x1875415569284864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788535769.935013:0:7941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ace00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7941:1875415569284864:0@lo:1000: 00000100:00100000:2.0:1788535769.935080:0:7941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535769.935112:0:7941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005893f3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535769.935138:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569284864 00000100:00100000:2.0:1788535769.935158:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569284864 00000100:00100000:2.0:1788535769.935203:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788535769.935211:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7941:x1875415569284864:12345-0@lo:1000: 00000040:00080000:1.0:1788535769.937594:0:7943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788535769.937683:0:7943:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788535769.937688:0:7943:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1788535769.948084:0:7464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1788535769.950324:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7941:x1875415569284864:12345-0@lo:1000: Request processed in 15093us (15223us total) trans 4294967298 rc 0/0 00000004:00080000:1.0:1788535769.950344:0:7941:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788535769.950351:0:7941:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788535769.950353:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788535769.950377:0:7941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ace00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7941:1875415569284864:0@lo:1000: 00010000:00010000:2.0:1788535770.285093:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535770.551558:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535770.551585:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569284992:0@lo:41: 00000100:00100000:0.0:1788535770.551655:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535770.551781:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569284992 00000100:00100000:1.0:1788535770.551802:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569284992 00000100:00100000:1.0:1788535770.551862:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788535770.551872:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569284992:12345-0@lo:41: 00000004:00000024:1.0:1788535770.551921:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788535770.551968:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569284992:12345-0@lo:41: Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535770.551976:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788535770.552066:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569284992:0@lo:41: 00010000:00010000:0.0:1788535771.311376:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535772.337529:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535773.356723:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535774.380302:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535775.149024:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569285120:0@lo:400: 00000100:00100000:1.0:1788535775.149115:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535775.149139:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569285120 00000100:00100000:1.0:1788535775.149189:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569285632:0@lo:400: 00000100:00100000:2.0:1788535775.149193:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569285120 00000100:00100000:1.0:1788535775.149233:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535775.149247:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788535775.149257:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:3662:x1875415569285120:12345-0@lo:400: 00000100:00100000:1.0:1788535775.149261:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788535775.149269:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569285248:0@lo:400: 00000100:00100000:2.0:1788535775.149316:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:3662:x1875415569285120:12345-0@lo:400: Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535775.149319:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535775.149329:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788535775.149362:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569285120:0@lo:400: 00000100:00100000:1.0:1788535775.149395:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569285376:0@lo:400: 00000100:00100000:1.0:1788535775.149420:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535775.149450:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535775.149456:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569285504:0@lo:400: 00000100:00100000:1.0:1788535775.149619:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535775.149656:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569285632 00000100:00100000:1.0:1788535775.149661:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569285632 00000100:00100000:1.0:1788535775.149686:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569285376 00000100:00100000:1.0:1788535775.149689:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569285376 00000100:00100000:1.0:1788535775.149705:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788535775.149712:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569285632:12345-0@lo:400: 00000100:00100000:1.0:1788535775.149756:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569285632:12345-0@lo:400: Request processed in 44us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535775.149769:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788535775.149784:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788535775.149791:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569285376:12345-0@lo:400: 00000100:00100000:1.0:1788535775.149828:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569285376:12345-0@lo:400: Request processed in 37us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535775.149834:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788535775.149865:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569285248 00000100:00100000:1.0:1788535775.149869:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569285248 00000100:00100000:1.0:1788535775.149892:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569285504 00000100:00100000:1.0:1788535775.149895:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569285504 00000100:00100000:1.0:1788535775.149908:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535775.149977:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569285248:12345-0@lo:400: 00000100:00100000:1.0:1788535775.150007:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569285248:12345-0@lo:400: Request processed in 34us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535775.150014:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535775.150026:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788535775.150032:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569285504:12345-0@lo:400: 00000100:00100000:1.0:1788535775.150055:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569285504:12345-0@lo:400: Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535775.150061:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788535775.150095:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90059e018e00 x1875415569285504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535775.150107:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569285504:0@lo:400: 00000100:00100000:1.0:1788535775.150118:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569285376:0@lo:400: 00010000:00080000:1.0:1788535775.150143:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90059e019c00 x1875415569285248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535775.150178:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569285248:0@lo:400: 00000100:00100000:1.0:1788535775.150192:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569285632:0@lo:400: 00000100:00100000:3.0:1788535775.151585:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569285760:0@lo:41: 00000100:00100000:3.0:1788535775.151641:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535775.151682:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569285760 00000100:00100000:3.0:1788535775.151688:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569285760 00000100:00100000:3.0:1788535775.151733:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788535775.151740:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569285760:12345-0@lo:41: 00000004:00000024:3.0:1788535775.151769:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788535775.151811:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569285760:12345-0@lo:41: Request processed in 71us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535775.151816:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788535775.151866:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569285760:0@lo:41: 00010000:00010000:3.0:1788535775.405362:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535775.662815:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569285888:0@lo:41: 00000100:00100000:3.0:1788535775.662891:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535775.663234:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569285888 00000100:00100000:1.0:1788535775.663242:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569285888 00000100:00100000:1.0:1788535775.663339:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788535775.663349:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569285888:12345-0@lo:41: 00000004:00000024:1.0:1788535775.663380:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788535775.663453:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569285888:12345-0@lo:41: Request processed in 105us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535775.663460:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788535775.663501:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569285888:0@lo:41: 00010000:00010000:2.0:1788535776.428377:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535777.454383:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535778.477299:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788535778.663514:0:8439:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788535778.663519:0:8439:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788535778.663520:0:8439:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788535778.663664:0:8439:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9005893a3800 00000020:01000004:0.0:1788535778.663681:0:8439:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788535778.663693:0:8439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788535778.663715:0:8439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90059e5d0000) 00000020:00000080:0.0:1788535778.663732:0:8439:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788535778.710044:0:8439:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788535778.710282:0:8439:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1788535778.740843:0:8439:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788535778.742272:0:8439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788535778.742286:0:8439:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788535778.742299:0:8439:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe79af2f39bbdc1b7 00000020:01000004:0.0:1788535778.742306:0:8439:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788535778.742325:0:8439:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788535778.742328:0:8439:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788535778.742333:0:8439:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788535778.742337:0:8439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788535778.742349:0:8439:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90059e5d3380) 00000020:00000080:0.0:1788535778.742358:0:8439:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788535778.747533:0:8439:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535778.747713:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788535778.747720:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788535778.749250:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788535778.749261:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788535778.749646:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788535778.749653:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788535778.752252:0:8439:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788535778.752434:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788535778.752439:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788535778.755082:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788535778.755095:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788535778.783704:0:8439:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535778.783960:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788535778.783966:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788535778.786049:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788535778.786075:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788535778.787809:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788535778.787820:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788535778.793013:0:8439:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788535778.793486:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788535778.793493:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788535778.795377:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788535778.795457:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788535778.849993:0:8439:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788535778.850230:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788535778.850236:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788535778.853227:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788535778.853248:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788535778.856288:0:8439:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788535778.856320:0:8439:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788535778.856326:0:8439:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788535778.887108:0:8439:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788535778.887143:0:8439:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788535778.887241:0:8439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788535778.887242:0:8439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788535778.887244:0:8439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535778.887245:0:8439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535778.887246:0:8439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535778.887247:0:8439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535778.887249:0:8439:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535778.887250:0:8439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535778.887257:0:8439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535778.887259:0:8439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535778.887260:0:8439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788535778.887263:0:8439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788535778.887266:0:8439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788535778.887267:0:8439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788535778.887268:0:8439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535778.887268:0:8439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535778.887269:0:8439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535778.887270:0:8439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535778.887271:0:8439:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535778.887272:0:8439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535778.887272:0:8439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535778.887273:0:8439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535778.887274:0:8439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788535778.887300:0:8439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788535778.887318:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569286016:0@lo:253: 00000100:00100000:2.0:1788535778.887498:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.887554:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5b4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788535778.887685:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569286016 00000100:00100000:0.0:1788535778.887693:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569286016 00000100:00100000:0.0:1788535778.887746:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788535778.887756:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+18:8439:x1875415569286016:12345-0@lo:253: 20000000:01000000:0.0:1788535778.887784:0:6526:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788535778.887797:0:6526:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788535778.887809:0:6526:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788535778.887812:0:6526:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788535778.888009:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788535778.888192:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788535778.888206:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788535778.888223:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788535778.888229:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788535778.888242:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788535778.888257:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788535778.888335:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788535778.888349:0:6526:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1788535778.888352:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788535778.888367:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788535778.888373:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788535778.888611:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788535778.888621:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1788535778.888638:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788535778.888646:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788535778.888660:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788535778.888676:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788535778.888747:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788535778.888759:0:6526:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1788535778.888760:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788535778.888803:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788535778.888811:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788535778.888834:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788535778.888840:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1788535778.888853:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788535778.888860:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788535778.888874:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788535778.888892:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788535778.889676:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788535778.889693:0:6526:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1788535778.889695:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788535778.889710:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788535778.889715:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788535778.889727:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788535778.889732:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1788535778.889743:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788535778.889749:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788535778.889760:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788535778.889776:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788535778.889798:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788535778.889801:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788535778.889805:0:6526:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788535778.889859:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788535778.889863:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788535778.890753:0:8458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788535778.890851:0:8458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788535778.890873:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788535778.891125:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788535778.891462:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788535778.891484:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788535778.891493:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788535778.891496:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788535778.891862:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788535778.892018:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788535778.892038:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788535778.892053:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788535778.892128:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788535778.892131:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788535778.892863:0:8460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788535778.892894:0:8460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788535778.892911:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788535778.893378:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788535778.893411:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788535778.893424:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788535778.893433:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788535778.893435:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788535778.894301:0:8461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788535778.894337:0:8461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788535778.894368:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788535778.894536:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788535778.894556:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788535778.894571:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1788535778.894586:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788535778.894623:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894640:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059632e600/0xe79af2f39bbdc091 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc08a expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894647:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc101 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894655:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc14e expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894662:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc16a expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894669:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1a2 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894677:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894717:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc1a2 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894734:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1a2 expref: 18 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.894748:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286144:0@lo:104: 00000100:00100000:1.0:1788535778.894831:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535778.894876:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc16a expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894902:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc16a expref: 18 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.894911:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286272:0@lo:104: 00000100:00100000:1.0:1788535778.894949:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535778.894982:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc14e expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.894991:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc14e expref: 18 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.895000:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286400:0@lo:104: 00000100:00100000:1.0:1788535778.895021:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535778.895051:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc101 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.895059:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc101 expref: 18 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.895081:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286528:0@lo:104: 00000100:00100000:1.0:1788535778.895104:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535778.895122:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059632e600/0xe79af2f39bbdc091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc08a expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.895130:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059632e600/0xe79af2f39bbdc091 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc08a expref: 18 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.895138:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286656:0@lo:104: 00000100:00100000:1.0:1788535778.895211:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535778.895222:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291240 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.895580:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569286144 00000100:00100000:2.0:1788535778.895588:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569286144 00000100:00100000:2.0:1788535778.895620:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569286272 00000100:00100000:2.0:1788535778.895623:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569286272 00000100:00100000:2.0:1788535778.895634:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569286400 00000100:00100000:2.0:1788535778.895636:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569286400 00000100:00100000:2.0:1788535778.895645:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569286528 00000100:00100000:2.0:1788535778.895647:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569286528 00000100:00100000:2.0:1788535778.895656:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569286656 00000100:00100000:2.0:1788535778.895665:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569286656 00000100:00100000:2.0:1788535778.895683:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788535778.895692:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e019c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+7:6526:x1875415569286144:12345-0@lo:104: 00010000:00010000:2.0:1788535778.895705:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.895769:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535778.895775:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e019c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+7:6526:x1875415569286144:12345-0@lo:104: Request processed in 85us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.895781:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788535778.895859:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535778.895866:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.895873:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e200 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:3.0:1788535778.895877:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.895885:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535778.895893:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535778.895905:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535778.895934:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.895941:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535778.895960:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.895967:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3e200/0xe79af2f39bbdc1a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc1a9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.895980:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535778.895982:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535778.895984:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535778.895995:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569286784:0@lo:103: 00000100:00100000:3.0:1788535778.896025:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.896179:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788535778.896186:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+6:6526:x1875415569286272:12345-0@lo:104: 00010000:00010000:2.0:1788535778.896195:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.896231:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535778.896236:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+6:6526:x1875415569286272:12345-0@lo:104: Request processed in 52us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.896242:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788535778.896254:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788535778.896260:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+5:6526:x1875415569286400:12345-0@lo:104: 00010000:00010000:2.0:1788535778.896268:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.896293:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788535778.896298:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+5:6526:x1875415569286400:12345-0@lo:104: Request processed in 39us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.896304:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788535778.896320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788535778.896326:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:6526:x1875415569286528:12345-0@lo:104: 00010000:00010000:2.0:1788535778.896333:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059632ea00/0xe79af2f39bbdc101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.896357:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788535778.896361:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:6526:x1875415569286528:12345-0@lo:104: Request processed in 36us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.896366:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788535778.896374:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788535778.896379:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6526:x1875415569286656:12345-0@lo:104: 00010000:00010000:2.0:1788535778.896454:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff900580030e00/0xe79af2f39bbdc08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.896481:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788535778.896486:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6526:x1875415569286656:12345-0@lo:104: Request processed in 107us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.896491:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788535778.896559:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788535778.896564:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896571:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f000 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:3.0:1788535778.896575:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896582:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535778.896588:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535778.896603:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535778.896619:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896624:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535778.896638:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896644:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059632f000/0xe79af2f39bbdc16a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc171 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896653:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788535778.896655:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896660:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f400 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:3.0:1788535778.896663:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896668:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535778.896674:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535778.896678:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535778.896688:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896713:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535778.896725:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896731:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdc14e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc155 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896739:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788535778.896742:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059632ea00/0xe79af2f39bbdc101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896747:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632ea00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:3.0:1788535778.896749:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059632ea00/0xe79af2f39bbdc101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896755:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059632ea00/0xe79af2f39bbdc101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535778.896761:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059632ea00/0xe79af2f39bbdc101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535778.896766:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535778.896778:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059632ea00/0xe79af2f39bbdc101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896784:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535778.896805:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059632ea00/0xe79af2f39bbdc101 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896811:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059632ea00/0xe79af2f39bbdc101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc108 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896819:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535778.896838:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff900580030e00/0xe79af2f39bbdc08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896843:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030e00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:3.0:1788535778.896846:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff900580030e00/0xe79af2f39bbdc08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896852:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff900580030e00/0xe79af2f39bbdc08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535778.896858:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff900580030e00/0xe79af2f39bbdc08a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535778.896864:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535778.896878:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff900580030e00/0xe79af2f39bbdc08a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896884:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535778.896889:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff900580030e00/0xe79af2f39bbdc08a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896895:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff900580030e00/0xe79af2f39bbdc08a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc091 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.896909:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535778.896911:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535778.896913:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535778.896926:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569286912:0@lo:103: 00000100:00100000:3.0:1788535778.896956:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.896987:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535778.896993:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569287040:0@lo:103: 00000100:00100000:3.0:1788535778.897023:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.897052:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569286784 00000100:00100000:3.0:1788535778.897058:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569286784 00010000:00010000:3.0:1788535778.897109:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1a2 expref: 19 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.897124:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569286912 00000100:00100000:3.0:1788535778.897126:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569286912 00010000:00010000:3.0:1788535778.897135:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc16a expref: 20 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.897143:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569287040 00000100:00100000:3.0:1788535778.897171:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569287040 00010000:00010000:3.0:1788535778.897181:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc14e expref: 21 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.897193:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788535778.897199:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+21:3661:x1875415569286784:12345-0@lo:103: 00010000:00010000:3.0:1788535778.897208:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535778.897213:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1a2 expref: 21 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897222:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1a2 expref: 21 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897239:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535778.897263:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+21:3661:x1875415569286784:12345-0@lo:103: Request processed in 65us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.897270:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788535778.897283:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788535778.897288:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+20:3662:x1875415569286912:12345-0@lo:103: 00010000:00010000:3.0:1788535778.897301:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535778.897306:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc16a expref: 20 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897314:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc16a expref: 20 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897324:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535778.897349:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+20:3662:x1875415569286912:12345-0@lo:103: Request processed in 61us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.897355:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788535778.897367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788535778.897373:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+19:3662:x1875415569287040:12345-0@lo:103: 00010000:00010000:3.0:1788535778.897380:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535778.897398:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc14e expref: 19 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897407:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc14e expref: 19 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897416:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535778.897437:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+19:3662:x1875415569287040:12345-0@lo:103: Request processed in 64us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.897442:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788535778.897463:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569287168:0@lo:103: 00000100:00100000:3.0:1788535778.897486:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.897509:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535778.897514:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569287296:0@lo:103: 00000100:00100000:3.0:1788535778.897549:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.897570:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569287168 00000100:00100000:3.0:1788535778.897573:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569287168 00010000:00010000:3.0:1788535778.897588:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc108 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc101 expref: 19 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.897601:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569287296 00000100:00100000:3.0:1788535778.897603:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569287296 00010000:00010000:3.0:1788535778.897611:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059632e600/0xe79af2f39bbdc091 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc08a expref: 20 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.897621:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788535778.897626:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+20:3660:x1875415569287168:12345-0@lo:103: 00010000:00010000:3.0:1788535778.897633:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535778.897636:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc108 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc101 expref: 20 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897643:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc101 expref: 20 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897651:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535778.897675:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+20:3660:x1875415569287168:12345-0@lo:103: Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.897681:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788535778.897692:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788535778.897697:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+19:3660:x1875415569287296:12345-0@lo:103: 00010000:00010000:3.0:1788535778.897705:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535778.897709:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059632e600/0xe79af2f39bbdc091 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc08a expref: 19 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897727:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059632e600/0xe79af2f39bbdc091 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc08a expref: 19 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897739:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897747:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897761:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897768:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897774:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897780:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897785:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:3.0:1788535778.897789:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897795:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897801:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.897819:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535778.897852:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+19:3660:x1875415569287296:12345-0@lo:103: Request processed in 155us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.897859:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788535778.897912:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569286784:0@lo:103: 00000100:00100000:3.0:1788535778.897936:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569287296:0@lo:103: 00000100:00100000:3.0:1788535778.897943:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569287168:0@lo:103: 00000100:00100000:3.0:1788535778.897961:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569287040:0@lo:103: 00000100:00100000:3.0:1788535778.897968:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569286912:0@lo:103: 00010000:00010000:3.0:1788535778.897983:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535778.898739:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900580030600/0xe79af2f39bbdc1a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc1a2 expref: 18 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.898754:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286144:0@lo:104: 00010000:00010000:1.0:1788535778.898766:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc16a expref: 17 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.898773:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286272:0@lo:104: 00010000:00010000:1.0:1788535778.898780:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51600/0xe79af2f39bbdc155 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc14e expref: 16 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.899027:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286400:0@lo:104: 00010000:00010000:1.0:1788535778.899042:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc101 expref: 15 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.899050:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286528:0@lo:104: 00010000:00010000:1.0:1788535778.899060:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632e600/0xe79af2f39bbdc091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc08a expref: 14 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535778.899080:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569286656:0@lo:104: 00010000:00010000:1.0:1788535778.899106:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.899116:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.899122:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.899139:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc1c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788535778.899181:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788535778.903669:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+13:8439:x1875415569286016:12345-0@lo:253: Request processed in 15900us (16157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535778.903684:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788535778.903782:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569286016:0@lo:253: 10000000:01000000:2.0:1788535778.903809:0:8439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788535778.903813:0:8439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788535778.903814:0:8439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788535778.903816:0:8439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535778.903817:0:8439:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788535778.903818:0:8439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535778.903829:0:8439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535778.903830:0:8439:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535778.903832:0:8439:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788535778.903833:0:8439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535778.903835:0:8439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788535778.903873:0:8439:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9005893a3800 from lustre-OST0000 10000000:01000000:2.0:1788535778.903905:0:8439:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788535778.903908:0:8439:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788535778.903916:0:8439:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9005baf299c0 local copy 10000000:01000000:2.0:1788535778.903921:0:8439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788535778.903962:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.903974:0:8439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.903984:0:8439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535778.904002:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569287424:0@lo:101: 00000100:00100000:2.0:1788535778.904040:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.904263:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535778.905339:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569287424 00000100:00100000:0.0:1788535778.905352:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569287424 00000100:00100000:1.0:1788535778.907684:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788535778.907697:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+13:8439:x1875415569287424:12345-0@lo:101: 00010000:00010000:1.0:1788535778.907714:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535778.907733:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc1d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc1cc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.907762:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1cc expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.907773:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc1d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1cc expref: 14 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535778.907782:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51400, rc 0) 00000100:00100000:1.0:1788535778.907883:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569287424:12345-0@lo:101: Request processed in 189us (3842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535778.907890:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788535778.907970:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569287424:0@lo:101: 00010000:00010000:3.0:1788535778.907990:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.907999:0:8439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.908113:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569287552:0@lo:501: 00000100:00100000:3.0:1788535778.908180:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.908457:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4563c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.908601:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569287552 00000100:00100000:2.0:1788535778.908607:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569287552 00000100:00100000:2.0:1788535778.908633:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788535778.908641:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569287552:12345-0@lo:501: 00000100:00100000:2.0:1788535778.908713:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569287552:12345-0@lo:501: Request processed in 72us (532us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788535778.908720:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788535778.908795:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569287552:0@lo:501: 10000000:01000000:3.0:1788535778.908810:0:8439:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788535778.908838:0:8439:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788535778.908858:0:8439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.908868:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.908875:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.908898:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788535778.908922:0:8439:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9005893a3800 10000000:01000000:3.0:1788535778.908927:0:8439:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788535778.908933:0:8439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788535778.908936:0:8439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788535778.908940:0:8439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788535778.908943:0:8439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788535778.908962:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.908969:0:8439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.908979:0:8439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.908993:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569287680:0@lo:101: 00000100:00100000:3.0:1788535778.909023:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.909035:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d456840 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.909189:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569287680 00000100:00100000:2.0:1788535778.909193:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569287680 00000100:00100000:2.0:1788535778.909211:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788535778.909217:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569287680:12345-0@lo:101: 00010000:00010000:2.0:1788535778.909223:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535778.909234:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc1da expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.909257:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1da expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.909267:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1da expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.909274:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461400, rc 0) 00000100:00100000:2.0:1788535778.909304:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569287680:12345-0@lo:101: Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.909309:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:2.0:1788535778.909330:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535778.909335:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.909343:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461e00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535778.909346:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.909354:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535778.909361:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535778.909367:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788535778.909397:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.909404:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535778.909428:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.909435:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe79af2f39bbdc1d3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.909446:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535778.909448:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535778.909449:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535778.909457:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535778.909467:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569287808:0@lo:103: 00000100:00100000:2.0:1788535778.909494:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.909525:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569287808 00000100:00100000:2.0:1788535778.909528:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569287808 00000100:00100000:2.0:1788535778.909556:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788535778.909562:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+15:3663:x1875415569287808:12345-0@lo:103: 00010000:00010000:2.0:1788535778.909570:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535778.909580:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc1d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc1cc expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.909589:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535778.909615:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+14:3663:x1875415569287808:12345-0@lo:103: Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.909620:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788535778.909645:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569287808:0@lo:103: 00000100:00100000:3.0:1788535778.909798:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569287680:0@lo:101: 00010000:00010000:3.0:1788535778.909811:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.909836:0:8439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535778.909895:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569287936:0@lo:501: 00000100:00100000:3.0:1788535778.909921:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.909950:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d456840 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.910037:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569287936 00000100:00100000:2.0:1788535778.910041:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569287936 00000100:00100000:2.0:1788535778.910058:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788535778.910076:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569287936:12345-0@lo:501: 00000100:00100000:2.0:1788535778.910204:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569287936:12345-0@lo:501: Request processed in 128us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.910211:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788535778.910339:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569287936:0@lo:501: 00000100:00100000:3.0:1788535778.910364:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288064:0@lo:503: 00000100:00100000:3.0:1788535778.910415:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.910440:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d456840 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.910528:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569288064 00000100:00100000:2.0:1788535778.910532:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569288064 00000100:00100000:2.0:1788535778.910549:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788535778.910554:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569288064:12345-0@lo:503: 00000100:00100000:2.0:1788535778.910635:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569288064:12345-0@lo:503: Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.910643:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788535778.912562:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288064:0@lo:503: 00000040:00080000:3.0:1788535778.912858:0:8439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788535778.912937:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288192:0@lo:502: 00000100:00100000:3.0:1788535778.913000:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.913037:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d456840 going to sleep for 11 seconds 00000100:00100000:3.0:1788535778.913484:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569288192 00000100:00100000:3.0:1788535778.913490:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569288192 00000100:00100000:3.0:1788535778.913522:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788535778.913530:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569288192:12345-0@lo:502: 00000100:00100000:3.0:1788535778.913628:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569288192:12345-0@lo:502: Request processed in 98us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.913636:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788535778.913678:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288192:0@lo:502: 00000040:00080000:3.0:1788535778.914251:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788535778.914287:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788535778.914298:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788535778.914309:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788535778.914320:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788535778.914331:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788535778.914362:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288320:0@lo:502: 00000100:00100000:3.0:1788535778.914618:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.914657:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d456840 going to sleep for 11 seconds 00000100:00100000:2.0:1788535778.914701:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569288320 00000100:00100000:2.0:1788535778.914707:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569288320 00000100:00100000:2.0:1788535778.914735:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788535778.914743:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569288320:12345-0@lo:502: 00000100:00100000:2.0:1788535778.914852:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569288320:12345-0@lo:502: Request processed in 110us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535778.914859:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788535778.914973:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288320:0@lo:502: 00000040:00080000:3.0:1788535778.915015:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788535778.915024:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788535778.915613:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788535778.915621:0:8462:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788535778.915627:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535778.915629:0:8462:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788535778.915636:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788535778.915651:0:8462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9005b7a7cd40) 00000020:00000080:2.0:1788535778.915671:0:8462:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788535778.915677:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788535778.915746:0:8462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9005893a3800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788535778.915756:0:8462:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788535778.915763:0:8462:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe79af2f39bbdc1ef 00010000:00010000:2.0:1788535778.922380:0:8462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788535778.923404:0:8462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788535778.927449:0:8462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788535778.928350:0:8462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788535778.934769:0:8462:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788535778.936869:0:8462:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788535778.950732:0:8462:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788535778.954576:0:8462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788535778.954587:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535778.954593:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535778.954595:0:8462:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788535778.954599:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535778.954602:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535778.954604:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788535778.954607:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788535778.954608:0:8462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788535778.954633:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535778.954635:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535778.954637:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788535778.954640:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788535778.959068:0:8439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788535778.959112:0:8439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788535778.959129:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.959142:0:8439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535778.966879:0:8439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005893a3800 from 1 10000000:01000000:2.0:1788535778.966887:0:8439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788535778.966930:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.967176:0:8439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.967188:0:8439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535778.967211:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288448:0@lo:101: 00000100:00100000:2.0:1788535778.967274:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.970143:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5b4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535778.974505:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569288448 00000100:00100000:3.0:1788535778.974518:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569288448 00000100:00100000:3.0:1788535778.974576:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788535778.974586:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:8439:x1875415569288448:12345-0@lo:101: 00010000:00010000:3.0:1788535778.974601:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535778.974617:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc1f6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.974662:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1f6 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.974673:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1f6 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535778.974683:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3e200, rc 0) 00000100:00100000:3.0:1788535778.975534:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569288448:12345-0@lo:101: Request processed in 945us (8255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535778.975541:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788535778.979547:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288448:0@lo:101: 00010000:00010000:2.0:1788535778.979599:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535778.979612:0:8439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535778.979739:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288576:0@lo:501: 00000100:00100000:2.0:1788535778.979795:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.979884:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5b4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535778.983361:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569288576 00000100:00100000:1.0:1788535778.983376:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569288576 00000100:00100000:1.0:1788535778.983552:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788535778.983563:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569288576:12345-0@lo:501: 00000100:00100000:1.0:1788535778.983759:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569288576:12345-0@lo:501: Request processed in 197us (3962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535778.983767:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788535778.983866:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288576:0@lo:501: 00000100:00100000:3.0:1788535778.983914:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288704:0@lo:503: 00000100:00100000:3.0:1788535778.985570:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535778.989682:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569288704 00000100:00100000:2.0:1788535778.989706:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569288704 00000100:00100000:3.0:1788535778.989729:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4560c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535778.990242:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788535778.990256:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569288704:12345-0@lo:503: 00000100:00100000:1.0:1788535778.990414:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569288704:12345-0@lo:503: Request processed in 162us (4848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535778.990422:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788535778.990664:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288704:0@lo:503: 00000040:00080000:3.0:1788535778.990961:0:8439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788535778.991051:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288832:0@lo:502: 00000100:00100000:3.0:1788535778.991832:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535778.994405:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535778.999671:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569288832 00000100:00100000:0.0:1788535778.999694:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569288832 00000100:00100000:0.0:1788535778.999759:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788535778.999769:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569288832:12345-0@lo:502: 00000100:00100000:0.0:1788535778.999957:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569288832:12345-0@lo:502: Request processed in 188us (8136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535778.999964:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788535778.999984:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288832:0@lo:502: 00000040:00080000:1.0:1788535779.000430:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788535779.000462:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788535779.000497:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288960:0@lo:502: 00000100:00100000:1.0:1788535779.000544:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.000579:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291900 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.001223:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569288960 00000100:00100000:1.0:1788535779.001231:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569288960 00000100:00100000:1.0:1788535779.001298:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788535779.001305:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569288960:12345-0@lo:502: 00000100:00100000:1.0:1788535779.001415:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569288960:12345-0@lo:502: Request processed in 109us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.001422:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788535779.001504:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569288960:0@lo:502: 00000040:00080000:3.0:1788535779.001560:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788535779.001570:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788535779.003194:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535779.003208:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535779.003211:0:8466:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788535779.003218:0:8466:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9005893a3800 00000020:00000080:3.0:1788535779.003235:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788535779.003255:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535779.003258:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535779.003259:0:8466:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788535779.003262:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788535779.003397:0:8439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788535779.003435:0:8439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788535779.003457:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.003480:0:8439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535779.003527:0:8439:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788535779.003530:0:8439:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9005893a3800 10000000:01000000:1.0:1788535779.003533:0:8439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9005893a3800 10000000:01000000:1.0:1788535779.003538:0:8439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788535779.003543:0:8439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005893a3800 from 1 10000000:01000000:1.0:1788535779.003546:0:8439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788535779.003584:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.003592:0:8439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.003602:0:8439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535779.003623:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289088:0@lo:101: 00000100:00100000:1.0:1788535779.003693:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.004287:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291900 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.004990:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569289088 00000100:00100000:0.0:1788535779.005000:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569289088 00000100:00100000:0.0:1788535779.005062:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788535779.005071:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:8439:x1875415569289088:12345-0@lo:101: 00010000:00010000:0.0:1788535779.005083:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535779.005108:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc204 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.005131:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc204 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.005143:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc204 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.005166:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455800, rc 0) 00000100:00100000:0.0:1788535779.005220:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569289088:12345-0@lo:101: Request processed in 150us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.005226:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788535779.005275:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289088:0@lo:101: 00010000:00010000:1.0:1788535779.005291:0:8439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.005301:0:8439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535779.005415:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289216:0@lo:501: 00000100:00100000:1.0:1788535779.005457:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.005486:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291900 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.005913:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569289216 00000100:00100000:2.0:1788535779.005919:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569289216 00000100:00100000:2.0:1788535779.005955:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788535779.005964:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569289216:12345-0@lo:501: 00000100:00100000:2.0:1788535779.006242:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569289216:12345-0@lo:501: Request processed in 278us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.006249:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788535779.008551:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289216:0@lo:501: 00000100:00100000:3.0:1788535779.008616:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289344:0@lo:503: 00000100:00100000:3.0:1788535779.008696:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.008737:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.008840:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569289344 00000100:00100000:0.0:1788535779.008848:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569289344 00000100:00100000:0.0:1788535779.008892:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788535779.008900:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569289344:12345-0@lo:503: 00000100:00100000:0.0:1788535779.009026:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569289344:12345-0@lo:503: Request processed in 126us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.009040:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788535779.009269:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289344:0@lo:503: 00000040:00080000:3.0:1788535779.009489:0:8439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788535779.009564:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289472:0@lo:502: 00000100:00100000:3.0:1788535779.009603:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.009635:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.009954:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569289472 00000100:00100000:2.0:1788535779.009959:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569289472 00000100:00100000:2.0:1788535779.009995:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788535779.010003:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569289472:12345-0@lo:502: 00000100:00100000:2.0:1788535779.010099:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569289472:12345-0@lo:502: Request processed in 96us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.010106:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788535779.010274:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289472:0@lo:502: 00000040:00080000:3.0:1788535779.010463:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788535779.010490:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788535779.010505:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788535779.010535:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788535779.010549:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788535779.010561:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788535779.010574:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788535779.010587:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788535779.010600:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788535779.010613:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788535779.010627:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788535779.010639:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788535779.010651:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788535779.010662:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788535779.010860:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788535779.010882:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788535779.010894:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788535779.010904:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788535779.010914:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788535779.010925:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788535779.010949:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788535779.010976:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788535779.010990:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788535779.011002:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788535779.011013:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788535779.011025:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788535779.011037:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788535779.011048:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788535779.011061:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788535779.011075:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788535779.011087:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788535779.011098:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788535779.011110:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788535779.011123:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788535779.011136:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788535779.011370:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788535779.011460:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1788535779.011581:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289600:0@lo:502: 00000100:00100000:3.0:1788535779.011646:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.011676:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.011788:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569289600 00000100:00100000:2.0:1788535779.011795:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569289600 00000100:00100000:2.0:1788535779.012014:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788535779.012030:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569289600:12345-0@lo:502: 00000100:00100000:2.0:1788535779.012137:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569289600:12345-0@lo:502: Request processed in 108us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.012167:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788535779.012325:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569289600:0@lo:502: 00000040:00080000:3.0:1788535779.012372:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788535779.012380:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788535779.013045:0:8467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788535779.013060:0:8467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9005baf2b380) 00000020:00000080:1.0:1788535779.015132:0:8467:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788535779.015270:0:8467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9005893a3800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788535779.015275:0:8467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9005893a3800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788535779.015277:0:8467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9005893a3800 3 00010000:00080000:1.0:1788535779.015851:0:8467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90048680f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788535779.020630:0:8467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788535779.024758:0:8467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788535779.024833:0:8467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788535779.024848:0:8467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe79af2f39bbdc219 00000100:00080000:0.0:1788535779.024859:0:8467:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788535779.024865:0:8467:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90048680f000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788535779.024911:0:8467:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9005842e4000 x1875415569289728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788535779.024946:0:8467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1788535779.025179:0:8467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788535779.025198:0:8467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90059e5d19c0) 00000020:00000080:0.0:1788535779.025212:0:8467:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788535779.025272:0:8467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9005893a3800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788535779.025275:0:8467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9005893a3800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788535779.025278:0:8467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9005893a3800 3 00010000:00080000:0.0:1788535779.025304:0:8467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90048695a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1788535779.027690:0:8467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:3.0:1788535779.028003:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3659:1875415569289728:0@lo:38: 00000100:00100000:3.0:1788535779.028077:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.028161:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569289984:0@lo:400: 00000100:00100000:3.0:1788535779.028191:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.028214:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535779.028221:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569290112:0@lo:400: 00000100:00100000:3.0:1788535779.028249:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.028282:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569289728 00000100:00100000:3.0:1788535779.028291:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569289728 00000100:00100000:3.0:1788535779.028317:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569290112 00000100:00100000:3.0:1788535779.028320:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569290112 00000100:00100000:3.0:1788535779.028345:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788535779.028354:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569290112:12345-0@lo:400: 00000100:00100000:3.0:1788535779.028409:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569290112:12345-0@lo:400: Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.028417:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788535779.028435:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788535779.028440:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1875415569289728:12345-0@lo:38: 00010000:00080000:3.0:1788535779.028467:0:6535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:3.0:1788535779.028507:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe79af2f39bbdc227 00000004:00100000:3.0:1788535779.028523:0:6535:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788535779.028556:0:6535:0:(import.c:65:import_set_state_nolock()) ffff900485ffb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788535779.028593:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875415569289728:12345-0@lo:38: Request processed in 151us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.028599:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788535779.028620:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569289984 00000100:00100000:3.0:1788535779.028624:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569289984 00000100:00100000:3.0:1788535779.028646:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788535779.028652:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569289984:12345-0@lo:400: 00000100:00100000:3.0:1788535779.028691:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569289984:12345-0@lo:400: Request processed in 39us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.028697:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788535779.028741:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff900485d92a00 x1875415569290112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535779.028756:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569290112:0@lo:400: 00000100:00100000:3.0:1788535779.028766:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569289984:0@lo:400: 00010000:00080000:3.0:1788535779.028794:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9005842e4000 x1875415569289728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788535789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535779.028801:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788535779.028808:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788535779.028814:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788535779.028817:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788535779.028831:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90048680f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788535779.028836:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3659:1875415569289728:0@lo:38: 00000100:00100000:2.0:1788535779.031220:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569289856:0@lo:400: 00000100:00100000:2.0:1788535779.031281:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.031320:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535779.031327:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569290240:0@lo:400: 00000100:00100000:2.0:1788535779.031349:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.031642:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569289856 00000100:00100000:3.0:1788535779.031650:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569289856 00000100:00100000:3.0:1788535779.031706:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788535779.031715:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569289856:12345-0@lo:400: 00000100:00100000:3.0:1788535779.031774:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569289856:12345-0@lo:400: Request processed in 61us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.031781:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788535779.031832:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff900485d90000 x1875415569289856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535779.031845:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569289856:0@lo:400: 00000100:00100000:1.0:1788535779.031892:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569290240 00000100:00100000:1.0:1788535779.031899:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569290240 00000100:00100000:1.0:1788535779.031934:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788535779.031943:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569290240:12345-0@lo:400: 00000100:00100000:1.0:1788535779.031984:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569290240:12345-0@lo:400: Request processed in 43us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.031990:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000080:0.0:1788535779.032075:0:8467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788535779.032121:0:8467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788535779.032133:0:8467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe79af2f39bbdc22e 00000100:00080000:0.0:1788535779.032141:0:8467:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788535779.032168:0:8467:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90048695a800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788535779.032195:0:8467:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9005842e6a00 x1875415569290368/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788535779.032212:0:8467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788535779.032536:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3659:1875415569290368:0@lo:38: 00000100:00100000:3.0:1788535779.032583:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.032636:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569290240:0@lo:400: 00000100:00100000:0.0:1788535779.035462:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569290368 00000100:00100000:0.0:1788535779.035474:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569290368 00000100:00100000:0.0:1788535779.035516:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788535779.035525:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1875415569290368:12345-0@lo:38: 00010000:00080000:0.0:1788535779.035555:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:0.0:1788535779.035616:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe79af2f39bbdc235 00000004:00100000:0.0:1788535779.035635:0:6533:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788535779.035669:0:6533:0:(import.c:65:import_set_state_nolock()) ffff90048695d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535779.035764:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875415569290368:12345-0@lo:38: Request processed in 239us (3179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.035772:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1788535779.035890:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:1.0:1788535779.036043:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9005842e6a00 x1875415569290368/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788535789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535779.036055:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788535779.036063:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788535779.036070:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788535779.036074:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788535779.036076:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90048695a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788535779.036081:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3659:1875415569290368:0@lo:38: 00000020:01000000:1.0:1788535779.036338:0:8439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788535779.036365:0:8439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788535779.036385:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.036396:0:8439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788535779.036438:0:8439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788535779.036441:0:8439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788535779.036442:0:8439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788535779.036443:0:8439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788535779.036445:0:8439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788535779.036446:0:8439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788535779.036447:0:8439:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788535779.036449:0:8439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788535779.036450:0:8439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788535779.036451:0:8439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788535779.036453:0:8439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788535779.036456:0:8439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788535779.036459:0:8439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788535779.036460:0:8439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788535779.036461:0:8439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788535779.036462:0:8439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788535779.036463:0:8439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788535779.036464:0:8439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788535779.036465:0:8439:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788535779.036466:0:8439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788535779.036467:0:8439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788535779.036468:0:8439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788535779.036469:0:8439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788535779.036491:0:8439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788535779.036504:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569290496:0@lo:253: 00000100:00100000:1.0:1788535779.036550:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.036589:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291840 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.039541:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569290496 00000100:00100000:2.0:1788535779.039557:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569290496 00000100:00100000:2.0:1788535779.039631:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788535779.039644:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569290496:12345-0@lo:253: 20000000:01000000:2.0:1788535779.039680:0:6528:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788535779.039697:0:6528:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788535779.046810:0:6528:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788535779.046862:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788535779.047044:0:6549:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788535779.047055:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788535779.047078:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.047097:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc139 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc132 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.047105:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc15c expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.047113:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535779.048368:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:8439:x1875415569290496:12345-0@lo:253: Request processed in 8718us (11809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.048458:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:8439:1875415569290496:0@lo:253: 10000000:01000000:1.0:1788535779.048483:0:8439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788535779.048485:0:8439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788535779.048487:0:8439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788535779.048488:0:8439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788535779.048490:0:8439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788535779.048491:0:8439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788535779.048492:0:8439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788535779.048493:0:8439:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788535779.048495:0:8439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788535779.048496:0:8439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788535779.048498:0:8439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788535779.048499:0:8439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788535779.048506:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000020:02000000:1.0:1788535779.048513:0:8439:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788535779.048632:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc15c expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.048648:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc15c expref: 15 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.048665:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569290624:0@lo:104: 00000100:00100000:0.0:1788535779.048880:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535779.048932:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc132 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.048941:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc132 expref: 15 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.048950:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569290752:0@lo:104: 00000100:00100000:0.0:1788535779.048969:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462840 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.049021:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788535779.049038:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.049069:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569290624 00000100:00100000:2.0:1788535779.049075:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569290624 00000100:00100000:2.0:1788535779.049104:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569290752 00000100:00100000:2.0:1788535779.049108:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569290752 00000100:00100000:2.0:1788535779.049121:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788535779.049129:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b78de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:6549:x1875415569290624:12345-0@lo:104: 00010000:00010000:2.0:1788535779.049346:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049414:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788535779.049420:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b78de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:6549:x1875415569290624:12345-0@lo:104: Request processed in 291us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.049507:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569290624:0@lo:104: 00000100:00100000:2.0:1788535779.049599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788535779.049636:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788535779.049643:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6549:x1875415569290752:12345-0@lo:104: 00010000:00010000:2.0:1788535779.049651:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058db3f200/0xe79af2f39bbdc132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049738:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788535779.049743:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6549:x1875415569290752:12345-0@lo:104: Request processed in 101us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.049750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788535779.049767:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788535779.049773:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049780:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580031a00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535779.049795:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049804:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535779.049812:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535779.049835:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788535779.049866:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049873:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535779.049893:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049904:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc15c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc163 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049917:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535779.049921:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3f200/0xe79af2f39bbdc132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049926:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3f200 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535779.049929:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3f200/0xe79af2f39bbdc132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049936:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3f200/0xe79af2f39bbdc132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535779.049942:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3f200/0xe79af2f39bbdc132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535779.049947:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788535779.049958:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058db3f200/0xe79af2f39bbdc132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049964:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535779.049993:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3f200/0xe79af2f39bbdc132 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.049999:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3f200/0xe79af2f39bbdc132 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc139 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050012:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535779.050015:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535779.050016:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535779.050022:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535779.050029:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535779.050042:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569290880:0@lo:103: 00000100:00100000:2.0:1788535779.050091:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.050122:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569291008:0@lo:103: 00000100:00100000:2.0:1788535779.050143:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.050202:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569290880 00000100:00100000:2.0:1788535779.050207:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569290880 00010000:00010000:2.0:1788535779.050225:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc15c expref: 16 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535779.050244:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569291008 00000100:00100000:2.0:1788535779.050247:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569291008 00010000:00010000:2.0:1788535779.050257:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc132 expref: 17 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535779.050270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788535779.050277:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+17:3662:x1875415569290880:12345-0@lo:103: 00010000:00010000:2.0:1788535779.050286:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535779.050291:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc15c expref: 17 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050310:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc15c expref: 17 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050323:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc15c expref: 17 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050336:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535779.050365:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+16:3662:x1875415569290880:12345-0@lo:103: Request processed in 88us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.050371:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788535779.050394:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788535779.050401:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+15:3660:x1875415569291008:12345-0@lo:103: 00010000:00010000:2.0:1788535779.050409:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535779.050413:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc139 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc132 expref: 15 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050434:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc139 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc132 expref: 15 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050459:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050468:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788535779.050481:0:6519:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011502205s 00010000:00010000:2.0:1788535779.050486:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050506:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050514:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050521:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050527:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455a00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788535779.050532:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050540:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050549:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.050560:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535779.050587:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+15:3660:x1875415569291008:12345-0@lo:103: Request processed in 186us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.050593:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788535779.050633:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569291008:0@lo:103: 00000100:00100000:2.0:1788535779.050655:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569290880:0@lo:103: 00010000:00010000:0.0:1788535779.051462:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc132 expref: 14 pid: 6529 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.051482:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569290752:0@lo:104: 00010000:00010000:0.0:1788535779.051501:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.051510:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.051517:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.051524:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc23c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788535779.055651:0:8439:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788535779.056999:0:8439:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788535779.057491:0:8439:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788535779.057660:0:8439:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788535779.058271:0:8439:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788535779.058693:0:8439:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788535779.060926:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788535779.070973:0:8439:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788535779.070992:0:8439:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788535779.071024:0:8439:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788535779.071070:0:8439:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788535779.071091:0:8439:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788535779.071212:0:8439:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788535779.071962:0:8439:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788535779.072223:0:8439:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788535779.500403:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788535779.517112:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788535779.517120:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005831a8000 from 30 10000000:01000000:2.0:1788535779.517125:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788535779.517208:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.517221:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.517233:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535779.517258:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291136:0@lo:101: 00000100:00100000:2.0:1788535779.517331:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.517465:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb540 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.519360:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569291136 00000100:00100000:1.0:1788535779.519372:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569291136 00000100:00100000:1.0:1788535779.519429:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788535779.519439:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+14:6531:x1875415569291136:12345-0@lo:101: 00010000:00010000:1.0:1788535779.519455:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535779.519471:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc243 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.519564:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc243 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.519577:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc243 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.519594:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50a00, rc 0) 00000100:00100000:1.0:1788535779.519658:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569291136:12345-0@lo:101: Request processed in 221us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.519664:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788535779.519906:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291136:0@lo:101: 00010000:00010000:0.0:1788535779.519924:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.519934:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.520001:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291264:0@lo:501: 00000100:00100000:0.0:1788535779.520048:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.520084:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e4629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.520428:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569291264 00000100:00100000:1.0:1788535779.520436:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569291264 00000100:00100000:1.0:1788535779.520476:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788535779.520483:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569291264:12345-0@lo:501: 00000100:00100000:1.0:1788535779.520621:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569291264:12345-0@lo:501: Request processed in 137us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.520628:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788535779.520660:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291264:0@lo:501: 00000100:00100000:1.0:1788535779.520704:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291392:0@lo:503: 00000100:00100000:1.0:1788535779.520751:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.520771:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900582eb9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.520783:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569291392 00000100:00100000:1.0:1788535779.520786:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569291392 00000100:00100000:1.0:1788535779.520807:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788535779.520813:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569291392:12345-0@lo:503: 00000100:00100000:1.0:1788535779.520904:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569291392:12345-0@lo:503: Request processed in 90us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.520909:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788535779.520946:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291392:0@lo:503: 00000100:00100000:3.0:1788535779.523372:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8493:1875415569291520:0@lo:502: 00000100:00100000:1.0:1788535779.523540:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.523600:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535779.524328:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569291520 00000100:00100000:3.0:1788535779.524339:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569291520 00000100:00100000:3.0:1788535779.524396:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788535779.524408:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:8493:x1875415569291520:12345-0@lo:502: 00000100:00100000:3.0:1788535779.524589:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:8493:x1875415569291520:12345-0@lo:502: Request processed in 182us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.524598:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788535779.524881:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8493:1875415569291520:0@lo:502: 00000100:00100000:0.0:1788535779.524949:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8493:1875415569291648:0@lo:502: 00000100:00100000:0.0:1788535779.525084:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.525192:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462900 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.534187:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569291648 00000100:00100000:2.0:1788535779.534203:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569291648 00000100:00100000:2.0:1788535779.534291:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788535779.534302:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:8493:x1875415569291648:12345-0@lo:502: 00000100:00100000:2.0:1788535779.534484:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:8493:x1875415569291648:12345-0@lo:502: Request processed in 184us (9398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.534493:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788535779.534550:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8493:1875415569291648:0@lo:502: 00000040:00080000:2.0:1788535779.534586:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788535779.534840:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788535779.534863:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788535779.534874:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.534886:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535779.534896:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788535779.534898:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9005831a8000 from 5 10000000:01000000:3.0:1788535779.534901:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788535779.534929:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.534937:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.534954:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535779.534983:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291776:0@lo:101: 00000100:00100000:3.0:1788535779.535020:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.535056:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.536579:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569291776 00000100:00100000:2.0:1788535779.536595:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569291776 00000100:00100000:2.0:1788535779.536658:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788535779.536669:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569291776:12345-0@lo:101: 00010000:00010000:2.0:1788535779.536683:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535779.536702:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc251 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.536747:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc251 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.536760:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc251 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.536769:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460600, rc 0) 00000100:00100000:2.0:1788535779.536863:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569291776:12345-0@lo:101: Request processed in 195us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.536870:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788535779.536983:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291776:0@lo:101: 00010000:00010000:1.0:1788535779.537003:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.537013:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535779.537094:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291904:0@lo:256: 00000100:00100000:1.0:1788535779.537142:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.537218:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900589627b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535779.537517:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569291904 00000100:00100000:3.0:1788535779.537524:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569291904 00000100:00100000:3.0:1788535779.537570:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788535779.537578:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569291904:12345-0@lo:256: 20000000:01000000:3.0:1788535779.537592:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788535779.537610:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788535779.537613:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788535779.537715:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569291904:12345-0@lo:256: Request processed in 138us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.537722:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788535779.537753:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569291904:0@lo:256: 10000000:01000000:3.0:1788535779.537795:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788535779.537803:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.537812:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535779.537834:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788535779.537837:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788535779.537840:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788535779.537870:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.537878:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.537886:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535779.537902:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569292032:0@lo:101: 00000100:00100000:3.0:1788535779.537929:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.538109:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5ddc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.538241:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569292032 00000100:00100000:2.0:1788535779.538247:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569292032 00000100:00100000:2.0:1788535779.538371:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788535779.538381:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569292032:12345-0@lo:101: 00010000:00010000:2.0:1788535779.538390:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535779.538407:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc25f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.538427:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc25f expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.538437:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc25f expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535779.538446:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461a00, rc 0) 00000100:00100000:2.0:1788535779.538487:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569292032:12345-0@lo:101: Request processed in 108us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.538493:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788535779.538566:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569292032:0@lo:101: 00010000:00010000:3.0:1788535779.538579:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.538586:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535779.538651:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569292160:0@lo:501: 00000100:00100000:3.0:1788535779.538675:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.538704:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5ddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.538747:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569292160 00000100:00100000:1.0:1788535779.538753:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569292160 00000100:00100000:1.0:1788535779.538781:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788535779.538788:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569292160:12345-0@lo:501: 00000100:00100000:1.0:1788535779.538929:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569292160:12345-0@lo:501: Request processed in 141us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.538935:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788535779.539088:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569292160:0@lo:501: 00000100:00100000:0.0:1788535779.539119:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569292288:0@lo:503: 00000100:00100000:0.0:1788535779.539393:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.539492:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.539524:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569292288 00000100:00100000:2.0:1788535779.539529:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569292288 00000100:00100000:2.0:1788535779.539562:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788535779.539569:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569292288:12345-0@lo:503: 00000100:00100000:2.0:1788535779.539725:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569292288:12345-0@lo:503: Request processed in 156us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.539732:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788535779.539789:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569292288:0@lo:503: 00000100:00100000:3.0:1788535779.540359:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8495:1875415569292416:0@lo:502: 00000100:00100000:3.0:1788535779.540402:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.540460:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.540492:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569292416 00000100:00100000:0.0:1788535779.540497:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569292416 00000100:00100000:0.0:1788535779.540563:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788535779.540570:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:8495:x1875415569292416:12345-0@lo:502: 00000100:00100000:0.0:1788535779.540667:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:8495:x1875415569292416:12345-0@lo:502: Request processed in 97us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.540674:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788535779.540732:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8495:1875415569292416:0@lo:502: 00000020:01000000:3.0:1788535779.540759:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788535779.540768:0:8495:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788535779.540781:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535779.540788:0:8495:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788535779.540794:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788535779.540798:0:8495:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:3.0:1788535779.540830:0:8495:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788535779.540833:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788535779.540863:0:8495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90059e1b19c0) 00000020:00000080:3.0:1788535779.540885:0:8495:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788535779.540892:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788535779.541047:0:8495:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788535779.541055:0:8495:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788535779.541063:0:8495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdc274 00010000:00080000:3.0:1788535779.541092:0:8495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9005b7b08000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788535779.541517:0:8495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788535779.553204:0:8495:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788535779.553237:0:8495:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788535779.553458:0:8495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788535779.554047:0:8495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788535779.554414:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788535779.554510:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788535779.555391:0:8496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535779.555397:0:8496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788535779.567791:0:8495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788535779.567809:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788535779.567871:0:8495:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788535779.567907:0:8495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdc27b 00000100:00080000:3.0:1788535779.567919:0:8495:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788535779.567926:0:8495:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9005b7b08000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788535779.568748:0:8495:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9005842e0700 x1875415569292544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788535779.568789:0:8495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788535779.568877:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535779.568894:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535779.568897:0:8495:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788535779.568901:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535779.568906:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535779.568908:0:8495:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788535779.568911:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788535779.568913:0:8495:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788535779.569139:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569292672:0@lo:400: 00000100:00100000:2.0:1788535779.569244:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.569277:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569293184:0@lo:400: 00000100:00100000:2.0:1788535779.569301:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.569322:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535779.569328:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569293056:0@lo:400: 00000100:00100000:2.0:1788535779.569354:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.569382:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569292800:0@lo:400: 00000100:00100000:2.0:1788535779.569403:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.569421:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569293312:0@lo:400: 00000100:00100000:2.0:1788535779.569445:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.569464:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535779.569469:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569292928:0@lo:400: 00000100:00100000:2.0:1788535779.569491:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.569516:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569292672 00000100:00100000:2.0:1788535779.569523:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569292672 00000100:00100000:1.0:1788535779.569549:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569292544:0@lo:8: 00000100:00100000:2.0:1788535779.569559:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569293184 00000100:00100000:2.0:1788535779.569564:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569293184 00000100:00100000:1.0:1788535779.569597:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.569598:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569293312 00000100:00100000:2.0:1788535779.569603:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569293312 00000100:00100000:2.0:1788535779.569647:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569292928 00000100:00100000:1.0:1788535779.569648:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569293056 00000100:00100000:2.0:1788535779.569651:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569292928 00000100:00100000:1.0:1788535779.569655:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569293056 00000100:00100000:2.0:1788535779.569671:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788535779.569681:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569292672:12345-0@lo:400: 00000100:00100000:1.0:1788535779.569685:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569292800 00000100:00100000:1.0:1788535779.569690:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569292800 00000100:00100000:1.0:1788535779.569707:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788535779.569716:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569293056:12345-0@lo:400: 00000100:00100000:2.0:1788535779.569739:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569292672:12345-0@lo:400: Request processed in 58us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.569746:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788535779.569766:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569293056:12345-0@lo:400: Request processed in 50us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.569767:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788535779.569778:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569293184:12345-0@lo:400: 00000100:00100000:1.0:1788535779.569792:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788535779.569812:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788535779.569829:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569293184:12345-0@lo:400: Request processed in 38us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.569836:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569292800:12345-0@lo:400: 00000100:00100000:2.0:1788535779.569841:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788535779.569859:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788535779.569867:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569293312:12345-0@lo:400: 00000100:00100000:1.0:1788535779.569883:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569292800:12345-0@lo:400: Request processed in 50us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.569891:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788535779.569905:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569293312:12345-0@lo:400: Request processed in 39us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.569913:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788535779.569934:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569292800:0@lo:400: 00000100:00100000:2.0:1788535779.569941:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788535779.569949:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e756a00 x1875415569293312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.569953:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569292928:12345-0@lo:400: 00000100:00100000:1.0:1788535779.569969:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569293312:0@lo:400: 00000100:00100000:2.0:1788535779.569992:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569292928:12345-0@lo:400: Request processed in 41us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.569999:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788535779.570002:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e754e00 x1875415569292928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535779.570013:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569292928:0@lo:400: 00000100:00100000:2.0:1788535779.570047:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569293056:0@lo:400: 00010000:00080000:2.0:1788535779.570059:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9005894ae300 x1875415569292672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.570069:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569292672:0@lo:400: 00010000:00080000:2.0:1788535779.570088:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e754a80 x1875415569293184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.570096:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569293184:0@lo:400: 00000100:00100000:3.0:1788535779.570392:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8495:1875415569293440:0@lo:502: 00000100:00080000:0.0:1788535779.570400:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788535779.570406:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535779.570426:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569292544 00000100:00100000:0.0:1788535779.570431:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569292544 00000100:00100000:3.0:1788535779.570444:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.570467:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535779.570473:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.570474:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3659:x1875415569292544:12345-0@lo:8: 00000100:00100000:2.0:1788535779.571013:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569293440 00000100:00100000:2.0:1788535779.571019:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569293440 00000100:00100000:2.0:1788535779.571062:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788535779.571069:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:8495:x1875415569293440:12345-0@lo:502: 00000100:00100000:2.0:1788535779.572255:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:8495:x1875415569293440:12345-0@lo:502: Request processed in 1181us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.572266:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1788535779.572959:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1788535779.572989:0:8446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdc282 00002000:00100000:0.0:1788535779.573030:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff900486958000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788535779.573035:0:8446:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788535779.573040:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788535779.573120:0:8446:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788535779.573344:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788535779.573372:0:8446:0:(import.c:65:import_set_state_nolock()) ffff90048695a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535779.573459:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1875415569292544:12345-0@lo:8: Request processed in 2983us (3862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.573467:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535779.574099:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8495:1875415569293440:0@lo:502: 00000020:01000000:3.0:1788535779.574141:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535779.574182:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535779.574185:0:8495:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788535779.574190:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788535779.574665:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788535779.574694:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788535779.574704:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.574716:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535779.574726:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788535779.574728:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005831fb800 from 30 10000000:01000000:0.0:1788535779.574731:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788535779.574765:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.574774:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.574782:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.574805:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569293568:0@lo:101: 00000100:00100000:0.0:1788535779.574886:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.574930:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535779.575175:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569293568 00000100:00100000:3.0:1788535779.575184:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569293568 00000100:00100000:3.0:1788535779.575233:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788535779.575243:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569293568:12345-0@lo:101: 00010000:00010000:3.0:1788535779.575255:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535779.575268:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc289 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.575289:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc289 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.575298:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc289 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.575312:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3e600, rc 0) 00000100:00100000:3.0:1788535779.575369:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569293568:12345-0@lo:101: Request processed in 126us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.575376:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1788535779.575669:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9005842e0700 x1875415569292544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788535789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.575681:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788535779.575690:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788535779.575697:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788535779.575701:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788535779.575705:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005b7b08000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788535779.575724:0:3659:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788535779.575730:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569292544:0@lo:8: 00000100:00100000:3.0:1788535779.575767:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8497:1875415569293696:0@lo:700: 00000100:00100000:3.0:1788535779.575800:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.575838:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dda80 going to sleep for 11 seconds 00000004:00080000:3.0:1788535779.575853:0:8496:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788535779.576025:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569293696 00000100:00100000:2.0:1788535779.576030:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569293696 00000100:00100000:2.0:1788535779.576070:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788535779.576078:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8497:x1875415569293696:12345-0@lo:700: 00000100:00100000:2.0:1788535779.576108:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8454:1875415569293824:0@lo:700: 00000100:00100000:2.0:1788535779.576136:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.576252:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb540 going to sleep for 11 seconds 00000100:00080000:2.0:1788535779.576264:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535779.576280:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569293824 00000100:00100000:2.0:1788535779.576284:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569293824 00000100:00100000:2.0:1788535779.576306:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788535779.576312:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8454:x1875415569293824:12345-0@lo:700: 00000004:00080000:3.0:1788535779.576500:0:8496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 238380352288ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788535779.576506:0:8496:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788535779.577389:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569293568:0@lo:101: 00010000:00010000:0.0:1788535779.577414:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.577426:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.578017:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569293952:0@lo:501: 00000100:00100000:0.0:1788535779.578085:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.578125:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.578180:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569293952 00000100:00100000:0.0:1788535779.578186:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569293952 00000100:00100000:0.0:1788535779.578223:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788535779.578234:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569293952:12345-0@lo:501: 00000004:00080000:2.0:1788535779.583689:0:7464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788535779.584681:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569293952:12345-0@lo:501: Request processed in 6443us (6598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.584703:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788535779.585345:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569293952:0@lo:501: 00000100:00100000:2.0:1788535779.585550:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294080:0@lo:503: 00000100:00100000:2.0:1788535779.585605:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.585678:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb6c0 going to sleep for 11 seconds 40000000:02000000:2.0:1788535779.590797:0:6540:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788535779.594879:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569294080 00000100:00100000:1.0:1788535779.594892:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569294080 00000100:00100000:1.0:1788535779.595169:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788535779.595180:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569294080:12345-0@lo:503: 00000100:00100000:1.0:1788535779.595346:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569294080:12345-0@lo:503: Request processed in 168us (9740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.595354:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788535779.595610:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294080:0@lo:503: 00000100:00100000:0.0:1788535779.595843:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8500:1875415569294208:0@lo:502: 00000100:00100000:0.0:1788535779.595903:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.595932:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569294208 00000100:00100000:0.0:1788535779.595937:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569294208 00000100:00100000:0.0:1788535779.595965:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788535779.595972:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:8500:x1875415569294208:12345-0@lo:502: 00000100:00100000:0.0:1788535779.596060:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:8500:x1875415569294208:12345-0@lo:502: Request processed in 88us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.596067:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788535779.596110:0:8500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.596123:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8500:1875415569294208:0@lo:502: 00000100:00100000:0.0:1788535779.596185:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8500:1875415569294336:0@lo:502: 00000100:00100000:0.0:1788535779.596239:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.596261:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569294336 00000100:00100000:0.0:1788535779.596265:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569294336 00000100:00100000:0.0:1788535779.596284:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788535779.596289:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:8500:x1875415569294336:12345-0@lo:502: 00000100:00100000:0.0:1788535779.596344:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:8500:x1875415569294336:12345-0@lo:502: Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.596350:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788535779.596377:0:8500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.596387:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8500:1875415569294336:0@lo:502: 00000040:00080000:0.0:1788535779.596404:0:8500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788535779.596455:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788535779.596474:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788535779.596482:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.596492:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535779.596513:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788535779.596521:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9005831fb800 from 5 10000000:01000000:0.0:1788535779.596524:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788535779.596546:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.596555:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.596565:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.596576:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294464:0@lo:101: 00000100:00100000:0.0:1788535779.596603:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.596619:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.596630:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569294464 00000100:00100000:0.0:1788535779.596633:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569294464 00000100:00100000:0.0:1788535779.596653:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788535779.596660:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569294464:12345-0@lo:101: 00010000:00010000:0.0:1788535779.596670:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535779.596683:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc297 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.596704:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc297 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.596713:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc297 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.596722:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454200, rc 0) 00000100:00100000:0.0:1788535779.596752:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569294464:12345-0@lo:101: Request processed in 92us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.596765:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788535779.596807:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294464:0@lo:101: 00010000:00010000:0.0:1788535779.596831:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.596841:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.596884:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294592:0@lo:256: 00000100:00100000:0.0:1788535779.596912:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.596925:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.596935:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569294592 00000100:00100000:0.0:1788535779.596938:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569294592 00000100:00100000:0.0:1788535779.596958:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788535779.596964:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569294592:12345-0@lo:256: 20000000:01000000:0.0:1788535779.596976:0:6528:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788535779.596992:0:6528:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788535779.596995:0:6528:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788535779.597068:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569294592:12345-0@lo:256: Request processed in 103us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.597075:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788535779.597108:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294592:0@lo:256: 10000000:01000000:0.0:1788535779.597168:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788535779.597174:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.597182:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535779.597195:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788535779.597197:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788535779.597199:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788535779.597215:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.597222:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.597229:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.597241:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294720:0@lo:101: 00000100:00100000:0.0:1788535779.597266:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.597280:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.597291:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569294720 00000100:00100000:0.0:1788535779.597294:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569294720 00000100:00100000:0.0:1788535779.597315:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788535779.597321:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569294720:12345-0@lo:101: 00010000:00010000:0.0:1788535779.597327:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535779.597336:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc2a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.597349:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc2a5 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.597357:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc2a5 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.597374:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455600, rc 0) 00000100:00100000:0.0:1788535779.597403:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569294720:12345-0@lo:101: Request processed in 82us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.597408:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788535779.597435:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294720:0@lo:101: 00010000:00010000:0.0:1788535779.597446:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535779.597453:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.597494:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294848:0@lo:501: 00000100:00100000:0.0:1788535779.597517:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535779.597529:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535779.597539:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569294848 00000100:00100000:0.0:1788535779.597542:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569294848 00000100:00100000:0.0:1788535779.597561:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788535779.597567:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569294848:12345-0@lo:501: 00000100:00100000:0.0:1788535779.597688:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569294848:12345-0@lo:501: Request processed in 121us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.597694:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788535779.598487:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294848:0@lo:501: 00000100:00100000:1.0:1788535779.598529:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294976:0@lo:503: 00000100:00100000:1.0:1788535779.598576:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.598619:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900589627240 going to sleep for 11 seconds 00000100:00100000:3.0:1788535779.598698:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569294976 00000100:00100000:3.0:1788535779.598704:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569294976 00000100:00100000:3.0:1788535779.598784:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788535779.598794:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569294976:12345-0@lo:503: 00000100:00100000:3.0:1788535779.598920:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569294976:12345-0@lo:503: Request processed in 126us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.598927:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788535779.602303:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569294976:0@lo:503: 00000100:00100000:1.0:1788535779.605828:0:8501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8501:1875415569295104:0@lo:502: 00000100:00100000:1.0:1788535779.605916:0:8501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.605958:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8454:x1875415569293824:12345-0@lo:700: Request processed in 29643us (29819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.605972:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788535779.606005:0:8501:0:(client.c:2716:ptlrpc_set_wait()) set ffff900589627480 going to sleep for 11 seconds 00010000:00080000:2.0:1788535779.606034:0:8454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e754a80 x1875415569293824/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535779.606050:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569295104 00000100:00100000:2.0:1788535779.606052:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8454:1875415569293824:0@lo:700: 00000100:00100000:0.0:1788535779.606058:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569295104 40000000:02000000:2.0:1788535779.606066:0:8454:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1788535779.606138:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788535779.606164:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:8501:x1875415569295104:12345-0@lo:502: 00000100:00100000:0.0:1788535779.606299:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:8501:x1875415569295104:12345-0@lo:502: Request processed in 152us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.606312:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788535779.606444:0:8501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8501:1875415569295104:0@lo:502: 00000020:01000000:1.0:1788535779.606472:0:8501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788535779.606481:0:8501:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788535779.606498:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535779.606501:0:8501:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788535779.606512:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788535779.606517:0:8501:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1788535779.606537:0:8501:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788535779.606540:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788535779.606563:0:8501:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90059fa94d40) 00000020:00000080:1.0:1788535779.606590:0:8501:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788535779.606597:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788535779.606682:0:8501:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788535779.606688:0:8501:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788535779.606706:0:8501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdc2ba 00010000:00080000:1.0:1788535779.606744:0:8501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90059fa9e800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788535779.606991:0:8501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1788535779.623370:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788535779.623670:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8497:x1875415569293696:12345-0@lo:700: Request processed in 47588us (47864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.623683:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788535779.623799:0:8497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9005842e1180 x1875415569293696/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535779.623814:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8497:1875415569293696:0@lo:700: 00000040:01000000:1.0:1788535779.626379:0:8501:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788535779.626408:0:8501:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788535779.626625:0:8501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535779.626848:0:8501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535779.626937:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788535779.627034:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788535779.628584:0:8503:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535779.628592:0:8503:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788535779.635754:0:8501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788535779.635774:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788535779.635829:0:8501:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788535779.635857:0:8501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdc2c1 00000100:00080000:1.0:1788535779.635868:0:8501:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788535779.635874:0:8501:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90059fa9e800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788535779.635916:0:8501:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900485d93480 x1875415569295232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788535779.636181:0:8501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788535779.636246:0:8501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535779.636251:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535779.636253:0:8501:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788535779.636255:0:8501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535779.636259:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535779.636261:0:8501:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788535779.636264:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788535779.636266:0:8501:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788535779.636298:0:8501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8501:1875415569295360:0@lo:502: 00000100:00100000:1.0:1788535779.636376:0:8501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.636413:0:8501:0:(client.c:2716:ptlrpc_set_wait()) set ffff900589627cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.636452:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569295360 00000100:00100000:1.0:1788535779.636458:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569295360 00000100:00100000:1.0:1788535779.637019:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788535779.637030:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:8501:x1875415569295360:12345-0@lo:502: 00000100:00100000:1.0:1788535779.637174:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:8501:x1875415569295360:12345-0@lo:502: Request processed in 144us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.637183:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788535779.637595:0:8501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:8501:1875415569295360:0@lo:502: 00000020:01000000:1.0:1788535779.637628:0:8501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535779.637639:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535779.637641:0:8501:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788535779.638314:0:8501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788535779.638712:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788535779.638738:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788535779.638749:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.638760:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535779.638783:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788535779.638786:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9005baf299c0 from 1 10000000:01000000:3.0:1788535779.638788:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788535779.638838:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.638848:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535779.638858:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535779.638882:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569295488:0@lo:101: 00000100:00100000:3.0:1788535779.639349:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.639390:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788535779.639726:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569295488 00000100:00100000:1.0:1788535779.639735:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569295488 00000100:00100000:1.0:1788535779.639786:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788535779.639796:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569295488:12345-0@lo:101: 00010000:00010000:1.0:1788535779.639809:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535779.639836:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc2c8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.639864:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc2c8 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.639876:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc2c8 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.639885:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50400, rc 0) 00000100:00100000:1.0:1788535779.640766:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569295488:12345-0@lo:101: Request processed in 967us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535779.640775:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788535779.640848:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569295488:0@lo:101: 00010000:00010000:1.0:1788535779.640871:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.640882:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535779.642347:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569295616:0@lo:501: 00000100:00100000:1.0:1788535779.642430:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535779.642464:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900589627780 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.642746:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569295232:0@lo:8: 00000100:00100000:2.0:1788535779.642788:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.642998:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569295616 00000100:00100000:3.0:1788535779.643005:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569295616 00000100:00100000:3.0:1788535779.643052:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788535779.643062:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569295616:12345-0@lo:501: 00000100:00100000:3.0:1788535779.643179:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569295616:12345-0@lo:501: Request processed in 118us (748us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788535779.643186:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788535779.643447:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569295616:0@lo:501: 10000000:01000000:1.0:1788535779.643497:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788535779.644012:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535779.644024:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535779.644405:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569295232 00000100:00100000:0.0:1788535779.644413:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569295232 00000100:00100000:0.0:1788535779.644449:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788535779.644455:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3659:x1875415569295232:12345-0@lo:8: 00010000:00080000:0.0:1788535779.644483:0:8448:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1788535779.645450:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdc2d6 00002000:00100000:0.0:1788535779.645469:0:8448:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90048695c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788535779.645474:0:8448:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788535779.645477:0:8448:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000004:00080000:2.0:1788535779.645641:0:8497:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788535779.645681:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e757100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8497:1875415569295872:0@lo:7: 00000100:00100000:2.0:1788535779.645751:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.645778:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.645794:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535779.645805:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569295744:0@lo:13: 00000100:00100000:2.0:1788535779.645841:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788535779.646131:0:8448:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788535779.646183:0:8448:0:(import.c:65:import_set_state_nolock()) ffff900486959000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535779.646735:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1875415569295232:12345-0@lo:8: Request processed in 2276us (3943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.646745:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788535779.646766:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569295872 00000100:00100000:0.0:1788535779.646772:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569295872 00000100:00100000:0.0:1788535779.646831:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788535779.646841:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8497:x1875415569295872:12345-0@lo:7: 00010000:00080000:2.0:1788535779.655858:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900485d93480 x1875415569295232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788535789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.655873:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788535779.655886:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788535779.655895:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788535779.655901:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788535779.655904:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059fa9e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788535779.655993:0:3659:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788535779.656000:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569295232:0@lo:8: 00000004:00080000:2.0:1788535779.656049:0:8503:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788535779.656118:0:8503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 238459970256ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788535779.656124:0:8503:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788535779.659631:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569295744 00000100:00100000:3.0:1788535779.659652:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569295744 00000100:00100000:3.0:1788535779.659698:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535779.659708:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3662:x1875415569295744:12345-0@lo:13: 00002000:00000024:3.0:1788535779.659732:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1788535779.659807:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3662:x1875415569295744:12345-0@lo:13: Request processed in 101us (13965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.659814:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788535779.660346:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9005842e1f80 x1875415569295744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.660366:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569295744:0@lo:13: 00000004:00080000:2.0:1788535779.661875:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788535779.662659:0:8448:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788535779.662666:0:8448:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788535779.662744:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8497:x1875415569295872:12345-0@lo:7: Request processed in 15901us (16990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.662760:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788535779.662896:0:8497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e757100 x1875415569295872/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.662911:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e757100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8497:1875415569295872:0@lo:7: 00000004:00080000:2.0:1788535779.662924:0:8497:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788535779.662957:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e757100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8497:1875415569296000:0@lo:5: 00000100:00100000:2.0:1788535779.662995:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.663025:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.663045:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569296000 00000100:00100000:2.0:1788535779.663049:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569296000 00000100:00100000:2.0:1788535779.663079:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535779.663085:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8497:x1875415569296000:12345-0@lo:5: 00002000:00080000:2.0:1788535779.663106:0:8447:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788535779.663131:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8497:x1875415569296000:12345-0@lo:5: Request processed in 46us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.663137:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788535779.663174:0:8497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e757100 x1875415569296000/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.663184:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e757100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8497:1875415569296000:0@lo:5: 00000004:00080000:2.0:1788535779.663190:0:8497:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788535779.663208:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e757100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8497:1875415569296128:0@lo:5: 00000100:00100000:2.0:1788535779.663226:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.663238:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.664449:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569296128 00000100:00100000:2.0:1788535779.664457:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569296128 00000100:00100000:2.0:1788535779.664500:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788535779.664691:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8497:x1875415569296128:12345-0@lo:5: 00002000:00080000:2.0:1788535779.664724:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788535779.666872:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8497:x1875415569296128:12345-0@lo:5: Request processed in 2176us (3637us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788535779.668188:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788535779.668255:0:8497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e757100 x1875415569296128/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.668288:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e757100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8497:1875415569296128:0@lo:5: 00000004:00080000:2.0:1788535779.668302:0:8497:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788535779.668385:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8497:1875415569296256:0@lo:900: 00000100:00100000:2.0:1788535779.668430:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.668456:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.669834:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535779.669853:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569296384:0@lo:13: 00000100:00100000:2.0:1788535779.669907:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.670079:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569296384 00000100:00100000:2.0:1788535779.670087:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569296384 00000100:00100000:2.0:1788535779.670164:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788535779.670174:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569296384:12345-0@lo:13: 00002000:00000024:2.0:1788535779.670195:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788535779.670234:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569296384:12345-0@lo:13: Request processed in 62us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.670241:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788535779.670278:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e755180 x1875415569296384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.670294:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569296384:0@lo:13: 00000004:00080000:2.0:1788535779.670310:0:8504:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788535779.670328:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8504:1875415569296512:0@lo:7: 00000100:00100000:2.0:1788535779.670354:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535779.670375:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569296512 00000100:00100000:2.0:1788535779.670378:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569296512 00000100:00100000:2.0:1788535779.670403:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535779.670417:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8504:x1875415569296512:12345-0@lo:7: 00000100:00080000:3.0:1788535779.670636:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535779.682823:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569296256 00000100:00100000:0.0:1788535779.682835:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569296256 00000100:00100000:0.0:1788535779.682899:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788535779.682908:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8497:x1875415569296256:12345-0@lo:900: 00000100:00100000:0.0:1788535779.684713:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8497:x1875415569296256:12345-0@lo:900: Request processed in 1800us (16275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535779.684726:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788535779.684780:0:8497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e754380 x1875415569296256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535779.684794:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8497:1875415569296256:0@lo:900: 00000100:00100000:3.0:1788535779.687271:0:8504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb0c0 going to sleep for 11 seconds 00002000:00080000:2.0:1788535779.691093:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788535779.691102:0:8446:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788535779.691215:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8504:x1875415569296512:12345-0@lo:7: Request processed in 20795us (20856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535779.691369:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788535779.691439:0:8504:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e755180 x1875415569296512/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.691456:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8504:1875415569296512:0@lo:7: 00000004:00080000:2.0:1788535779.691470:0:8504:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788535779.693458:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8504:1875415569296640:0@lo:5: 00000100:00100000:3.0:1788535779.693557:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.693603:0:8504:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.694117:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569296640 00000100:00100000:2.0:1788535779.694126:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569296640 00000100:00100000:2.0:1788535779.697887:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788535779.697924:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8504:x1875415569296640:12345-0@lo:5: 00002000:00080000:2.0:1788535779.697959:0:8448:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788535779.697963:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1788535779.708141:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1788535779.708190:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788535779.708198:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788535779.709736:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8504:x1875415569296640:12345-0@lo:5: Request processed in 11820us (16170us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788535779.709750:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788535779.714300:0:8504:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e755180 x1875415569296640/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535779.714315:0:8504:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788535779.714321:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8504:1875415569296640:0@lo:5: 00000004:00080000:3.0:1788535779.714335:0:8504:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788535779.714389:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8504:1875415569296768:0@lo:700: 00000100:00100000:3.0:1788535779.714443:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.714595:0:8504:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.718445:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569296768 00000100:00100000:2.0:1788535779.718463:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569296768 00000100:00100000:2.0:1788535779.718641:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788535779.718663:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8504:x1875415569296768:12345-0@lo:700: 00000100:00100000:3.0:1788535779.740108:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8504:x1875415569296768:12345-0@lo:700: Request processed in 21438us (25654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535779.740127:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788535779.740209:0:8504:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9005842e0380 x1875415569296768/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535779.740293:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8504:1875415569296768:0@lo:700: 00000004:02000040:3.0:1788535779.748926:0:8504:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788535779.757378:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8504:1875415569296896:0@lo:5: 00000100:00100000:3.0:1788535779.757446:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535779.757513:0:8504:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788535779.757618:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569296896 00000100:00100000:2.0:1788535779.757627:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569296896 00000100:00100000:2.0:1788535779.757695:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788535779.757704:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8504:x1875415569296896:12345-0@lo:5: 00002000:00080000:3.0:1788535779.776760:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788535779.776782:0:8446:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00010000:00080000:2.0:1788535779.783633:0:8504:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9005842e0380 x1875415569296896/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535779.783655:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8504:1875415569296896:0@lo:5: 00000100:00100000:3.0:1788535779.783716:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8504:x1875415569296896:12345-0@lo:5: Request processed in 26010us (26267us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788535779.783727:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:2.0:1788535779.783744:0:8504:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:2.0:1788535780.029962:0:8531:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788535780.030579:0:8531:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788535780.274178:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535780.274205:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569297024:0@lo:41: 00000100:00100000:0.0:1788535780.274273:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535780.274343:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569297024 00000100:00100000:0.0:1788535780.274350:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569297024 00000100:00100000:0.0:1788535780.274390:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788535780.274398:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569297024:12345-0@lo:41: 00000004:00000024:0.0:1788535780.274429:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788535780.274473:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569297024:12345-0@lo:41: Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535780.274481:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788535780.274523:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569297024:0@lo:41: 00010000:00010000:0.0:1788535780.525423:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535780.781926:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535780.781959:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569297152:0@lo:41: 00000100:00100000:0.0:1788535780.782036:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535780.782099:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569297152 00000100:00100000:0.0:1788535780.782106:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569297152 00000100:00100000:0.0:1788535780.782173:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788535780.782182:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569297152:12345-0@lo:41: 00000004:00000024:0.0:1788535780.782219:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788535780.782269:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569297152:12345-0@lo:41: Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535780.782276:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788535780.782319:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569297152:0@lo:41: 00010000:00010000:2.0:1788535781.555602:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535782.573308:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535783.596329:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535784.620657:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535784.880088:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535784.880113:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569297280:0@lo:13: 00000100:00100000:2.0:1788535784.880194:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535784.880255:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569297280 00000100:00100000:2.0:1788535784.880262:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569297280 00000100:00100000:2.0:1788535784.880310:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535784.880320:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569297280:12345-0@lo:13: 00002000:00000024:2.0:1788535784.880346:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535784.880387:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569297280:12345-0@lo:13: Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.880393:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788535784.880461:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059e755180 x1875415569297280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535784.880480:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569297280:0@lo:13: 00000100:00080000:3.0:1788535784.880934:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535784.881036:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569297792:0@lo:400: 00000100:00100000:0.0:1788535784.881073:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535784.881096:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569298304:0@lo:400: 00000100:00100000:0.0:1788535784.881118:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535784.881137:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788535784.881142:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569297664:0@lo:400: 00000100:00100000:0.0:1788535784.881183:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535784.881201:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569298176:0@lo:400: 00000100:00100000:0.0:1788535784.881225:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535784.881249:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569297792 00000100:00100000:0.0:1788535784.881254:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569297792 00000100:00100000:0.0:1788535784.881285:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569298176 00000100:00100000:0.0:1788535784.881288:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569298176 00000100:00100000:0.0:1788535784.881310:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788535784.881317:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569297792:12345-0@lo:400: 00000100:00100000:0.0:1788535784.881366:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569297792:12345-0@lo:400: Request processed in 49us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.881373:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788535784.881387:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788535784.881393:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569298176:12345-0@lo:400: 00000100:00100000:0.0:1788535784.881421:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569298176:12345-0@lo:400: Request processed in 28us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.881427:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788535784.881458:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569297664 00000100:00100000:0.0:1788535784.881461:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569297664 00000100:00100000:0.0:1788535784.881487:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788535784.881493:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569297664:12345-0@lo:400: 00000100:00100000:0.0:1788535784.881524:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569297664:12345-0@lo:400: Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.881530:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788535784.881566:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569297664:0@lo:400: 00010000:00080000:0.0:1788535784.881577:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487467100 x1875415569298176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535784.881586:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569298176:0@lo:400: 00010000:00080000:0.0:1788535784.881595:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487467b80 x1875415569297792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535784.881603:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569297792:0@lo:400: 00000100:00100000:2.0:1788535784.881884:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569297408:0@lo:400: 00000100:00100000:2.0:1788535784.881918:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535784.881953:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569297920:0@lo:400: 00000100:00100000:2.0:1788535784.881976:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535784.882001:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569298432:0@lo:13: 00000100:00100000:2.0:1788535784.882035:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535784.882059:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788535784.882065:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569297536:0@lo:400: 00000100:00100000:2.0:1788535784.882088:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535784.882103:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569298048:0@lo:400: 00000100:00100000:2.0:1788535784.882124:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535784.882174:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569298432 00000100:00100000:2.0:1788535784.882179:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569298432 00000100:00100000:2.0:1788535784.882208:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788535784.882215:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569298432:12345-0@lo:13: 00002000:00000024:2.0:1788535784.882228:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535784.882261:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569298432:12345-0@lo:13: Request processed in 47us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535784.882267:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788535784.882297:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9005842e7800 x1875415569298432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535784.882307:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788535784.882323:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569298432:0@lo:13: 00000100:00100000:0.0:1788535784.882400:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569297408 00000100:00100000:0.0:1788535784.882404:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569297408 00000100:00100000:0.0:1788535784.882431:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788535784.882457:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:3660:x1875415569297408:12345-0@lo:400: 00000100:00100000:0.0:1788535784.882492:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:3660:x1875415569297408:12345-0@lo:400: Request processed in 37us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.882498:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788535784.882524:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569297536 00000100:00100000:0.0:1788535784.882527:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569297536 00000100:00100000:0.0:1788535784.882547:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569298048 00000100:00100000:0.0:1788535784.882550:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569298048 00000100:00100000:0.0:1788535784.882565:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788535784.882571:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569297536:12345-0@lo:400: 00000100:00100000:0.0:1788535784.882600:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569297536:12345-0@lo:400: Request processed in 29us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.882606:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788535784.882617:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788535784.882623:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569298048:12345-0@lo:400: 00000100:00100000:0.0:1788535784.882650:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569298048:12345-0@lo:400: Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.882655:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788535784.882673:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569297920 00000100:00100000:0.0:1788535784.882676:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569297920 00000100:00100000:0.0:1788535784.882837:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788535784.882844:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569297920:12345-0@lo:400: 00000100:00100000:0.0:1788535784.882878:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569297920:12345-0@lo:400: Request processed in 36us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535784.882884:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788535784.882967:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487465c00 x1875415569297536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535784.882978:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569297536:0@lo:400: 00010000:00080000:2.0:1788535784.882988:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487465180 x1875415569298048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535784.882996:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569298048:0@lo:400: 00000100:00100000:2.0:1788535784.883017:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569297408:0@lo:400: 00000100:00100000:2.0:1788535784.883027:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569297920:0@lo:400: 00000100:00100000:3.0:1788535784.885847:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569298304 00000100:00100000:3.0:1788535784.885862:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569298304 00000100:00100000:3.0:1788535784.885926:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788535784.885937:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569298304:12345-0@lo:400: 00000100:00100000:3.0:1788535784.886027:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569298304:12345-0@lo:400: Request processed in 93us (4907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535784.886034:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788535784.886055:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535784.886060:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535784.886063:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788535784.886093:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487466d80 x1875415569298304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535784.886108:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569298304:0@lo:400: 00000001:02000400:0.0:1788535785.323462:0:8821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788535785.394210:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535785.394231:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569298560:0@lo:41: 00000100:00100000:3.0:1788535785.394291:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535785.395313:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569298560 00000100:00100000:0.0:1788535785.395331:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569298560 00000100:00100000:0.0:1788535785.395389:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788535785.395399:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569298560:12345-0@lo:41: 00000004:00000024:0.0:1788535785.395438:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788535785.395504:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569298560:12345-0@lo:41: Request processed in 108us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535785.395511:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000001:00080000:3.0:1788535785.405985:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788535785.406121:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569298560:0@lo:41: 00010000:00010000:0.0:1788535785.647647:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535785.900322:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535785.900349:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569298688:0@lo:41: 00000100:00100000:0.0:1788535785.900413:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535785.900472:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569298688 00000100:00100000:0.0:1788535785.900479:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569298688 00000100:00100000:0.0:1788535785.900518:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788535785.900525:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569298688:12345-0@lo:41: 00000004:00000024:0.0:1788535785.900557:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788535785.900593:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569298688:12345-0@lo:41: Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535785.900600:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788535785.900640:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569298688:0@lo:41: 00000020:00000004:0.0:1788535786.197745:0:8873:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788535786.198550:0:8873:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788535786.669291:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535787.696879:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535788.718543:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788535788.892262:0:8975:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788535788.892476:0:8975:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788535789.740893:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788535789.773767:0:9023:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788535789.773779:0:9023:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1788535789.998352:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788535789.998376:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569299328:0@lo:13: 00000100:00100000:2.0:1788535789.998429:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569299072:0@lo:400: 00000100:00100000:0.0:1788535789.998456:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535789.998515:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569299328 00000100:00100000:0.0:1788535789.998522:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569298944:0@lo:400: 00000100:00100000:3.0:1788535789.998524:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569299328 00000100:00100000:0.0:1788535789.998555:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535789.998582:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569298816:0@lo:13: 00000100:00100000:2.0:1788535789.998583:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535789.998590:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788535789.998602:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569299328:12345-0@lo:13: 00000100:00100000:0.0:1788535789.998610:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535789.998625:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569299840:0@lo:400: 00002000:00000024:3.0:1788535789.998633:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535789.998662:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535789.998676:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569299584:0@lo:400: 00000100:00100000:1.0:1788535789.998728:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569299456:0@lo:400: 00010000:00080000:0.0:1788535790.000811:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487465880 x1875415569299328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535790.000825:0:3662:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788535790.000851:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569299328:0@lo:13: 00000100:00100000:0.0:1788535790.000894:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569299072 00000100:00100000:0.0:1788535790.000901:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569299072 00000100:00100000:0.0:1788535790.000945:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569299840 00000100:00100000:0.0:1788535790.000948:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569299840 00000100:00100000:0.0:1788535790.000968:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788535790.000974:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569299072:12345-0@lo:400: 00000100:00100000:0.0:1788535790.001031:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569299072:12345-0@lo:400: Request processed in 56us (2449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535790.003241:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788535790.003277:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788535790.003294:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569299840:12345-0@lo:400: 00000100:00100000:0.0:1788535790.003386:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569299840:12345-0@lo:400: Request processed in 101us (4724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535790.003393:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788535790.003444:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cfc700 x1875415569299840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535790.003473:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569299840:0@lo:400: 00000100:00100000:3.0:1788535790.003585:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569299328:12345-0@lo:13: Request processed in 4985us (5126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535790.003595:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788535790.003612:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569298816 00000100:00100000:3.0:1788535790.003618:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569298816 00000100:00100000:3.0:1788535790.003643:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788535790.003648:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569298816:12345-0@lo:13: 00002000:00000024:3.0:1788535790.003662:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535790.003710:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569298816:12345-0@lo:13: Request processed in 61us (5103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535790.003716:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788535790.003733:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535790.003738:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535790.003762:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569298944 00000100:00100000:3.0:1788535790.003767:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569298944 00000100:00100000:3.0:1788535790.003795:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788535790.003801:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:3662:x1875415569298944:12345-0@lo:400: 00000100:00100000:3.0:1788535790.003906:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:3662:x1875415569298944:12345-0@lo:400: Request processed in 104us (5350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535790.003912:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788535790.004014:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569298944:0@lo:400: 00010000:00080000:0.0:1788535790.004027:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9005842e7b80 x1875415569298816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535790.004042:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569298816:0@lo:13: 00000100:00100000:0.0:1788535790.004251:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535790.004291:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569299968:0@lo:400: 00000100:00100000:0.0:1788535790.004319:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535790.004386:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569299200:0@lo:400: 00000100:00100000:3.0:1788535790.004414:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535790.004439:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569299712:0@lo:400: 00000100:00100000:3.0:1788535790.004470:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535790.004496:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569299968 00000100:00100000:3.0:1788535790.004500:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569299968 00000100:00100000:3.0:1788535790.004526:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788535790.004532:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569299968:12345-0@lo:400: 00000100:00100000:3.0:1788535790.004563:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569299968:12345-0@lo:400: Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535790.004569:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788535790.004628:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569299200 00000100:00100000:0.0:1788535790.004632:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569299200 00000100:00100000:0.0:1788535790.004663:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788535790.004669:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569299200:12345-0@lo:400: 00000100:00100000:0.0:1788535790.004702:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569299200:12345-0@lo:400: Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535790.004708:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788535790.004722:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569299456 00000100:00100000:0.0:1788535790.004725:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569299456 00000100:00100000:0.0:1788535790.004739:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569299712 00000100:00100000:0.0:1788535790.004741:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569299712 00000100:00100000:0.0:1788535790.004774:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788535790.004780:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569299456:12345-0@lo:400: 00000100:00100000:0.0:1788535790.004806:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569299456:12345-0@lo:400: Request processed in 26us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535790.004876:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788535790.004888:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788535790.004907:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569299712:12345-0@lo:400: 00000100:00100000:0.0:1788535790.004936:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569299712:12345-0@lo:400: Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535790.004943:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788535790.004957:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788535790.004979:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cfdc00 x1875415569299456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535790.004992:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569299456:0@lo:400: 00010000:00080000:0.0:1788535790.005004:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cfd180 x1875415569299968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535790.005012:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569299968:0@lo:400: 00000100:00100000:3.0:1788535790.005090:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569299200:0@lo:400: 00010000:00080000:3.0:1788535790.005100:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cffb80 x1875415569299712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535790.005108:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569299712:0@lo:400: 00000100:00100000:2.0:1788535790.006190:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535790.006232:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569300096:0@lo:400: 00000100:00100000:2.0:1788535790.006267:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535790.006298:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569300096 00000100:00100000:2.0:1788535790.006305:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569300096 00000100:00100000:3.0:1788535790.006346:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569299584 00000100:00100000:3.0:1788535790.006351:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569299584 00000100:00100000:2.0:1788535790.006352:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788535790.006363:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569300096:12345-0@lo:400: 00000100:00100000:3.0:1788535790.006386:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788535790.006396:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569299584:12345-0@lo:400: 00000100:00100000:2.0:1788535790.006404:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569300096:12345-0@lo:400: Request processed in 42us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535790.006413:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535790.006439:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569299584:12345-0@lo:400: Request processed in 45us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535790.006446:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788535790.006473:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cff100 x1875415569300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535790.006486:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569300096:0@lo:400: 00010000:00080000:2.0:1788535790.006511:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cfe680 x1875415569299072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535790.006521:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569299072:0@lo:400: 00000100:00100000:2.0:1788535790.006541:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569299584:0@lo:400: 00000100:00100000:3.0:1788535790.508432:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535790.508460:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569300224:0@lo:41: 00000100:00100000:3.0:1788535790.508537:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535790.508606:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569300224 00000100:00100000:3.0:1788535790.508613:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569300224 00000100:00100000:3.0:1788535790.508655:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788535790.508664:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569300224:12345-0@lo:41: 00000004:00000024:3.0:1788535790.508708:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788535790.508829:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569300224:12345-0@lo:41: Request processed in 164us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535790.508836:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788535790.509721:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569300224:0@lo:41: 00010000:00010000:3.0:1788535790.765910:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535791.021264:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569300352:0@lo:41: 00000100:00100000:0.0:1788535791.021333:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535791.021493:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569300352 00000100:00100000:3.0:1788535791.021502:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569300352 00000100:00100000:3.0:1788535791.021550:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788535791.021560:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569300352:12345-0@lo:41: 00000004:00000024:3.0:1788535791.021595:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788535791.021651:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569300352:12345-0@lo:41: Request processed in 92us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535791.021657:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788535791.021750:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569300352:0@lo:41: 00010000:00010000:0.0:1788535791.791448:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535792.813735:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535793.837030:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535794.862142:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535795.121587:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569300480:0@lo:400: 00000100:00100000:1.0:1788535795.121653:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.121719:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569300992:0@lo:400: 00000100:00100000:1.0:1788535795.121747:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.121767:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569301504:0@lo:400: 00000100:00100000:1.0:1788535795.121800:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.121825:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788535795.121831:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569300864:0@lo:400: 00000100:00100000:1.0:1788535795.121855:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.121871:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569301376:0@lo:400: 00000100:00100000:1.0:1788535795.121890:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.121918:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569300480 00000100:00100000:1.0:1788535795.121936:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569300480 00000100:00100000:1.0:1788535795.121977:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788535795.121985:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:3663:x1875415569300480:12345-0@lo:400: 00000100:00100000:1.0:1788535795.122031:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:3663:x1875415569300480:12345-0@lo:400: Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.122039:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788535795.122071:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569300992 00000100:00100000:1.0:1788535795.122075:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569300992 00000100:00100000:1.0:1788535795.122113:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788535795.122120:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569300992:12345-0@lo:400: 00000100:00100000:1.0:1788535795.122174:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569300992:12345-0@lo:400: Request processed in 54us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.122180:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788535795.122202:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569301504 00000100:00100000:1.0:1788535795.122206:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569301504 00000100:00100000:1.0:1788535795.122235:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569301376 00000100:00100000:1.0:1788535795.122237:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569301376 00000100:00100000:1.0:1788535795.122259:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788535795.122265:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569301504:12345-0@lo:400: 00000100:00100000:1.0:1788535795.122294:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569301504:12345-0@lo:400: Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.122299:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788535795.122310:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788535795.122316:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569301376:12345-0@lo:400: 00000100:00100000:1.0:1788535795.122339:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569301376:12345-0@lo:400: Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.122345:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788535795.122362:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569300864 00000100:00100000:1.0:1788535795.122372:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569300864 00000100:00100000:1.0:1788535795.122399:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788535795.122405:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569300864:12345-0@lo:400: 00000100:00100000:1.0:1788535795.122434:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569300864:12345-0@lo:400: Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.122439:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788535795.122463:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535795.122494:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cfdf80 x1875415569300864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535795.122507:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569300864:0@lo:400: 00010000:00080000:1.0:1788535795.122518:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cfd500 x1875415569301376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535795.122525:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569301376:0@lo:400: 00000100:00100000:1.0:1788535795.122533:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569300480:0@lo:400: 00000100:00100000:1.0:1788535795.122541:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569300992:0@lo:400: 00010000:00080000:1.0:1788535795.122549:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cfd180 x1875415569301504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535795.122555:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569301504:0@lo:400: 00000100:00100000:1.0:1788535795.122594:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569300608:0@lo:400: 00000100:00100000:1.0:1788535795.122618:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.122635:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569301120:0@lo:400: 00000100:00100000:1.0:1788535795.122657:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.122672:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788535795.122677:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569300736:0@lo:400: 00000100:00100000:1.0:1788535795.122705:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.122737:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569301248:0@lo:400: 00000100:00100000:1.0:1788535795.122756:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.122778:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569300608 00000100:00100000:1.0:1788535795.122782:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569300608 00000100:00100000:1.0:1788535795.122797:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569301120 00000100:00100000:1.0:1788535795.122799:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569301120 00000100:00100000:1.0:1788535795.122817:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569301248 00000100:00100000:1.0:1788535795.122819:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569301248 00000100:00100000:1.0:1788535795.122832:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788535795.122837:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569300608:12345-0@lo:400: 00000100:00100000:1.0:1788535795.122871:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569300608:12345-0@lo:400: Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.122878:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788535795.122890:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788535795.122895:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569301120:12345-0@lo:400: 00000100:00100000:1.0:1788535795.122921:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569301120:12345-0@lo:400: Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.122927:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788535795.122937:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535795.122958:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569301248:12345-0@lo:400: 00000100:00100000:1.0:1788535795.122985:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569301248:12345-0@lo:400: Request processed in 43us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.122990:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788535795.123006:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535795.123008:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535795.123017:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569300736 00000100:00100000:1.0:1788535795.123025:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569300736 00000100:00100000:1.0:1788535795.123048:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788535795.123054:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569300736:12345-0@lo:400: 00000100:00100000:1.0:1788535795.128411:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569300736:12345-0@lo:400: Request processed in 5346us (5693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.128426:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788535795.128506:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569300736:0@lo:400: 00010000:00080000:1.0:1788535795.128520:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cffb80 x1875415569301248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535795.128531:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569301248:0@lo:400: 00010000:00080000:1.0:1788535795.128542:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cfe680 x1875415569300608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535795.128549:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569300608:0@lo:400: 00010000:00080000:1.0:1788535795.128559:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cff800 x1875415569301120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535795.128566:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569301120:0@lo:400: 00000100:00100000:1.0:1788535795.129634:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788535795.129652:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569301632:0@lo:13: 00000100:00100000:1.0:1788535795.129733:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.129779:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569301632 00000100:00100000:1.0:1788535795.129786:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569301632 00000100:00100000:1.0:1788535795.129829:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788535795.129838:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569301632:12345-0@lo:13: 00002000:00000024:1.0:1788535795.129864:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535795.129909:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569301632:12345-0@lo:13: Request processed in 72us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.129925:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788535795.129963:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900485d91500 x1875415569301632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535795.129978:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569301632:0@lo:13: 00000100:00100000:3.0:1788535795.133897:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535795.133920:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569301760:0@lo:13: 00000100:00100000:3.0:1788535795.134028:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535795.134077:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569301760 00000100:00100000:1.0:1788535795.134084:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569301760 00000100:00100000:1.0:1788535795.134142:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788535795.134169:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569301760:12345-0@lo:13: 00002000:00000024:1.0:1788535795.134191:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535795.134254:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569301760:12345-0@lo:13: Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535795.134261:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788535795.134632:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487464000 x1875415569301760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535795.134649:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569301760:0@lo:13: 00000100:00100000:0.0:1788535795.628980:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569301888:0@lo:41: 00000100:00100000:0.0:1788535795.629051:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535795.629176:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569301888 00000100:00100000:2.0:1788535795.629183:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569301888 00000100:00100000:2.0:1788535795.629304:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535795.629314:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569301888:12345-0@lo:41: 00000004:00000024:2.0:1788535795.629343:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788535795.629391:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569301888:12345-0@lo:41: Request processed in 80us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535795.629398:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788535795.630388:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569301888:0@lo:41: 00010000:00010000:1.0:1788535795.884969:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535796.141410:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569302016:0@lo:41: 00000100:00100000:1.0:1788535796.141495:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535796.141683:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569302016 00000100:00100000:3.0:1788535796.141692:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569302016 00000100:00100000:3.0:1788535796.141755:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788535796.141766:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569302016:12345-0@lo:41: 00000004:00000024:3.0:1788535796.141802:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788535796.141880:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569302016:12345-0@lo:41: Request processed in 116us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535796.141887:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788535796.142065:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569302016:0@lo:41: 00010000:00010000:2.0:1788535796.920157:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535797.932315:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535798.956362:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788535799.259404:0:9522:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788535799.259407:0:9522:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788535799.259409:0:9522:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788535799.259523:0:9522:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff900485fef800 00000020:01000004:2.0:1788535799.259537:0:9522:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788535799.259549:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788535799.259560:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9005b7a78000) 00000020:00000080:2.0:1788535799.259572:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788535799.347984:0:9522:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788535799.348046:0:9522:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788535799.369407:0:9522:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788535799.369631:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788535799.369645:0:9522:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788535799.369657:0:9522:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe79af2f39bbdc2e4 00000020:01000004:3.0:1788535799.369665:0:9522:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788535799.369698:0:9522:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788535799.369702:0:9522:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788535799.369708:0:9522:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788535799.369737:0:9522:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788535799.369741:0:9522:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788535799.396510:0:9522:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788535799.396546:0:9522:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788535799.396550:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788535799.396552:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788535799.396553:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535799.396554:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535799.396555:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535799.396557:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535799.396558:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535799.396560:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535799.396561:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535799.396562:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535799.396564:0:9522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788535799.396567:0:9522:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788535799.396641:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788535799.396642:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788535799.396643:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535799.396644:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535799.396645:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535799.396646:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535799.396647:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535799.396648:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535799.396649:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535799.396650:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535799.396651:0:9522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788535799.396675:0:9522:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788535799.396704:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569302144:0@lo:253: 00000100:00100000:2.0:1788535799.396769:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.396878:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535799.396995:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569302144 00000100:00100000:3.0:1788535799.397003:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569302144 00000100:00100000:3.0:1788535799.397100:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788535799.397110:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:9522:x1875415569302144:12345-0@lo:253: 20000000:01000000:3.0:1788535799.397180:0:6526:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788535799.397184:0:6526:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788535799.397190:0:6526:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788535799.397193:0:6526:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788535799.397391:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788535799.397524:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788535799.397538:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788535799.397555:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788535799.397561:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788535799.397592:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788535799.397609:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788535799.397708:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788535799.397724:0:6526:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:3.0:1788535799.397726:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:3.0:1788535799.397750:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788535799.397757:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788535799.397770:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788535799.397776:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:3.0:1788535799.397789:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788535799.398047:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788535799.398126:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788535799.398231:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788535799.398314:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788535799.398327:0:6526:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:3.0:1788535799.398329:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:3.0:1788535799.398344:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788535799.398349:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788535799.398363:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788535799.398367:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:3.0:1788535799.398379:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788535799.398385:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788535799.398397:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788535799.398412:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788535799.399954:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788535799.401971:0:6526:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:0.0:1788535799.401976:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:0.0:1788535799.402030:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788535799.402040:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788535799.402086:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788535799.402093:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:0.0:1788535799.402109:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788535799.402117:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788535799.402129:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788535799.402173:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788535799.402198:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788535799.402201:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788535799.402205:0:6526:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788535799.402260:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788535799.402262:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788535799.402749:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788535799.402991:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788535799.403014:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788535799.403029:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1788535799.403039:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788535799.403041:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788535799.403620:0:9529:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788535799.403640:0:9529:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788535799.403652:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788535799.403800:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788535799.403818:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788535799.403830:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1788535799.403838:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788535799.403839:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788535799.404393:0:9530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788535799.404445:0:9530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788535799.404458:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788535799.404615:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788535799.404633:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1788535799.404644:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1788535799.404656:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788535799.404657:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788535799.405247:0:9531:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788535799.405267:0:9531:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788535799.405278:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788535799.405528:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788535799.405545:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788535799.405556:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788535799.405564:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788535799.405566:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788535799.405889:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788535799.405918:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788535799.405935:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1788535799.406122:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1788535799.406141:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1788535799.406343:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:0.0:1788535799.406359:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788535799.406381:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406402:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1da expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406411:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc204 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406418:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc243 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406434:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc25f expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406441:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc289 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406447:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc2a5 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406454:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc2c8 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406462:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406504:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc2c8 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406519:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc2c8 expref: 21 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.406534:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302272:0@lo:104: 00000100:00100000:0.0:1788535799.406598:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535799.406651:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc2a5 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406660:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc2a5 expref: 21 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.406668:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302400:0@lo:104: 00000100:00100000:0.0:1788535799.406708:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535799.406777:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc289 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.406785:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc289 expref: 21 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.406803:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302528:0@lo:104: 00000100:00100000:0.0:1788535799.406824:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535799.407645:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc25f expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.407657:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc25f expref: 21 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.407667:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302656:0@lo:104: 00000100:00100000:0.0:1788535799.407706:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535799.407753:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569302272 00000100:00100000:3.0:1788535799.407759:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569302272 00000100:00100000:3.0:1788535799.407853:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569302400 00000100:00100000:3.0:1788535799.407857:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569302400 00000100:00100000:3.0:1788535799.407871:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569302528 00000100:00100000:3.0:1788535799.407873:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569302528 00000100:00100000:3.0:1788535799.407885:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788535799.408031:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+5:6526:x1875415569302272:12345-0@lo:104: 00010000:00010000:3.0:1788535799.408046:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.408298:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788535799.408304:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+5:6526:x1875415569302272:12345-0@lo:104: Request processed in 402us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.408311:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788535799.408331:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788535799.408337:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:6526:x1875415569302400:12345-0@lo:104: 00010000:00010000:3.0:1788535799.408347:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.408471:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc243 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.408481:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc243 expref: 21 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.408490:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302784:0@lo:104: 00000100:00100000:0.0:1788535799.408512:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535799.408530:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc204 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.408541:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc204 expref: 21 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.408562:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302912:0@lo:104: 00000100:00100000:0.0:1788535799.408586:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535799.408602:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc1da expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.408609:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1da expref: 21 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.408617:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569303040:0@lo:104: 00000100:00100000:0.0:1788535799.408632:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff900481cfaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535799.408652:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302272:0@lo:104: 00000100:00100000:0.0:1788535799.408661:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302400:0@lo:104: 00010000:00010000:2.0:1788535799.408719:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788535799.408726:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.408733:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3fa00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535799.408738:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.408747:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535799.408754:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535799.408760:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788535799.408900:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.408920:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535799.408952:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.408960:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3fa00/0xe79af2f39bbdc2c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc2cf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.408973:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535799.408977:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.408982:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454800 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535799.408986:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.408992:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535799.408997:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535799.409002:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788535799.409019:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.409025:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535799.409030:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.409036:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e454800/0xe79af2f39bbdc2a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc2ac expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.409046:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535799.409053:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535799.409055:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535799.409078:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569303296:0@lo:103: 00000100:00100000:2.0:1788535799.409109:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.409132:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535799.409138:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569303168:0@lo:103: 00000100:00100000:2.0:1788535799.409190:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.409223:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569303296 00000100:00100000:2.0:1788535799.409228:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569303296 00010000:00010000:2.0:1788535799.409250:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc2a5 expref: 22 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.409272:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569303168 00000100:00100000:2.0:1788535799.409275:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569303168 00010000:00010000:2.0:1788535799.409286:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc2c8 expref: 23 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.409297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788535799.409303:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+23:3661:x1875415569303296:12345-0@lo:103: 00010000:00010000:2.0:1788535799.409312:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535799.409316:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc2a5 expref: 23 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.409326:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc2a5 expref: 23 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.409338:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e455600/0xe79af2f39bbdc2ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc2a5 expref: 23 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.409349:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535799.409382:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+22:3661:x1875415569303296:12345-0@lo:103: Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.409389:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788535799.409404:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788535799.409410:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+21:3661:x1875415569303168:12345-0@lo:103: 00010000:00010000:2.0:1788535799.409417:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535799.409422:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc2c8 expref: 21 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.409430:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc2c8 expref: 21 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.409439:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc2cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc2c8 expref: 21 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.409448:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535799.409470:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+20:3661:x1875415569303168:12345-0@lo:103: Request processed in 60us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.409475:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788535799.409503:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569303168:0@lo:103: 00000100:00100000:2.0:1788535799.409511:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569303296:0@lo:103: 00010000:00010000:3.0:1788535799.410066:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788535799.410076:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:6526:x1875415569302400:12345-0@lo:104: Request processed in 1738us (3367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.410083:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788535799.410112:0:6518:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788535799.410132:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535799.410252:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569302656 00000100:00100000:3.0:1788535799.410258:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569302656 00000100:00100000:3.0:1788535799.410278:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569302784 00000100:00100000:3.0:1788535799.410281:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569302784 00000100:00100000:3.0:1788535799.410289:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569302912 00000100:00100000:3.0:1788535799.410291:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569302912 00000100:00100000:3.0:1788535799.410300:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569303040 00000100:00100000:3.0:1788535799.410302:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569303040 00000100:00100000:3.0:1788535799.410312:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788535799.410318:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+7:6526:x1875415569302528:12345-0@lo:104: 00010000:00010000:3.0:1788535799.410340:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.410461:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302528:0@lo:104: 00010000:00010000:0.0:1788535799.410557:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535799.410564:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.410570:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455a00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535799.410574:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.410583:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535799.410590:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535799.410596:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535799.410637:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.410644:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788535799.410693:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569303424:0@lo:103: 00000100:00100000:2.0:1788535799.410726:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535799.410776:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.410784:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e455a00/0xe79af2f39bbdc289 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc290 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.410805:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535799.410807:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535799.410809:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535799.410927:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788535799.410934:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+7:6526:x1875415569302528:12345-0@lo:104: Request processed in 616us (4109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.410942:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788535799.410961:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788535799.410969:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+6:6526:x1875415569302656:12345-0@lo:104: 00010000:00010000:3.0:1788535799.410977:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.411050:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788535799.411063:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+6:6526:x1875415569302656:12345-0@lo:104: Request processed in 89us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.411070:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788535799.411083:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788535799.411089:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+5:6526:x1875415569302784:12345-0@lo:104: 00010000:00010000:3.0:1788535799.411097:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.411124:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788535799.411129:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+5:6526:x1875415569302784:12345-0@lo:104: Request processed in 41us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.411134:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788535799.411271:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788535799.411280:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:6526:x1875415569302912:12345-0@lo:104: 00010000:00010000:3.0:1788535799.411294:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.411323:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788535799.411328:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485fdac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:6526:x1875415569302912:12345-0@lo:104: Request processed in 51us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.411335:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788535799.411365:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788535799.411371:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+3:6526:x1875415569303040:12345-0@lo:104: 00010000:00010000:3.0:1788535799.411378:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.411403:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788535799.411408:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+3:6526:x1875415569303040:12345-0@lo:104: Request processed in 38us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.411413:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788535799.411433:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569303424 00000100:00100000:3.0:1788535799.411437:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569303424 00010000:00010000:3.0:1788535799.411456:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc289 expref: 20 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535799.411478:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788535799.411484:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+20:3662:x1875415569303424:12345-0@lo:103: 00010000:00010000:3.0:1788535799.411493:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535799.411498:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc289 expref: 20 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.411507:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc289 expref: 20 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.411528:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058db3e600/0xe79af2f39bbdc290 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc289 expref: 20 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.411540:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535799.411595:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788535799.411600:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.411605:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3fe00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535799.411608:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.411616:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535799.411623:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535799.411629:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535799.411656:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.411663:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788535799.412006:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302656:0@lo:104: 00000100:00100000:1.0:1788535799.412029:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302784:0@lo:104: 00000100:00100000:1.0:1788535799.412039:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569302912:0@lo:104: 00000100:00100000:1.0:1788535799.412045:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6526:1875415569303040:0@lo:104: 00010000:00010000:1.0:1788535799.412090:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535799.414572:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+19:3662:x1875415569303424:12345-0@lo:103: Request processed in 3079us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.414586:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1788535799.415244:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788535799.415330:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.415342:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc25f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc266 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.415355:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788535799.415359:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.415366:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50000 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535799.415369:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.415377:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535799.415384:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535799.415390:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535799.415470:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.415477:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535799.415505:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.415512:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc20b expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.415523:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788535799.415537:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569303680:0@lo:103: 00010000:00010000:0.0:1788535799.415540:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.415548:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3ec00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535799.415551:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.415558:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535799.415565:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535799.415571:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788535799.415604:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.415676:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569303424:0@lo:103: 00000100:00100000:2.0:1788535799.415705:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535799.415851:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569303552:0@lo:103: 00000100:00100000:2.0:1788535799.415885:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.415924:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569303680 00000100:00100000:2.0:1788535799.415930:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569303680 00010000:00010000:2.0:1788535799.415956:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc204 expref: 19 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.415978:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569303552 00000100:00100000:2.0:1788535799.415981:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569303552 00010000:00010000:2.0:1788535799.415992:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc25f expref: 20 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.416004:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788535799.416011:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfa8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+20:3660:x1875415569303680:12345-0@lo:103: 00010000:00010000:2.0:1788535799.416021:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535799.416025:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc204 expref: 20 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.416034:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc204 expref: 20 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.416047:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc20b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc204 expref: 20 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.416071:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535799.416103:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfa8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+19:3660:x1875415569303680:12345-0@lo:103: Request processed in 92us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.416109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788535799.416180:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788535799.416187:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+18:3662:x1875415569303552:12345-0@lo:103: 00010000:00010000:2.0:1788535799.416195:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535799.416206:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc25f expref: 18 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.416215:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc25f expref: 18 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.416225:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc25f expref: 18 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.416234:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535799.416258:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+17:3662:x1875415569303552:12345-0@lo:103: Request processed in 71us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.416264:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788535799.416291:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569303680:0@lo:103: 00000100:00100000:2.0:1788535799.416321:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569303552:0@lo:103: 00010000:00010000:3.0:1788535799.421402:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535799.421410:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535799.421412:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535799.421451:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.421465:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460200 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535799.421469:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.421479:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535799.421486:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535799.421491:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788535799.421521:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.421522:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.421530:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535799.421551:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535799.421555:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.421561:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc1da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc1e1 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.421563:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.421569:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc24a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.421579:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535799.421581:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535799.421581:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535799.421582:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535799.421583:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535799.421584:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535799.421598:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569303808:0@lo:103: 00000100:00100000:0.0:1788535799.421598:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569303936:0@lo:103: 00000100:00100000:2.0:1788535799.427455:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535799.432568:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.433640:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569303808 00000100:00100000:2.0:1788535799.433650:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569303808 00010000:00010000:2.0:1788535799.433701:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc243 expref: 17 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.433736:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569303936 00000100:00100000:2.0:1788535799.433738:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569303936 00010000:00010000:2.0:1788535799.433749:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1da expref: 18 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.433763:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788535799.433770:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+18:3662:x1875415569303808:12345-0@lo:103: 00010000:00010000:2.0:1788535799.433784:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535799.433800:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc243 expref: 18 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.433811:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc243 expref: 18 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.433841:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc24a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc243 expref: 18 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.433856:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535799.433911:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+17:3662:x1875415569303808:12345-0@lo:103: Request processed in 140us (6463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.433918:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788535799.433935:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788535799.433940:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+16:3661:x1875415569303936:12345-0@lo:103: 00010000:00010000:2.0:1788535799.433946:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535799.433950:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1da expref: 16 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.433957:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1da expref: 16 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.433966:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc1e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc1da expref: 16 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.433975:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.433983:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.434009:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.434015:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.434027:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.434033:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.434039:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788535799.434043:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.434051:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.434065:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.434075:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535799.434103:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+15:3661:x1875415569303936:12345-0@lo:103: Request processed in 162us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.434108:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788535799.434549:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569303808:0@lo:103: 00000100:00100000:0.0:1788535799.437497:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569303936:0@lo:103: 00010000:00010000:0.0:1788535799.438902:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.438918:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.438925:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc2eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788535799.438943:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788535799.443125:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+14:9522:x1875415569302144:12345-0@lo:253: Request processed in 45995us (46334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535799.443140:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788535799.443940:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569302144:0@lo:253: 10000000:01000000:2.0:1788535799.443956:0:9522:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788535799.443959:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788535799.443960:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788535799.443962:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535799.443963:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788535799.443965:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535799.443966:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535799.443981:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535799.443982:0:9522:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788535799.443984:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535799.443985:0:9522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788535799.444007:0:9522:0:(tgt_mount.c:101:server_register_mount()) register mount ffff900485fef800 from lustre-OST0001 10000000:01000000:2.0:1788535799.444036:0:9522:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788535799.444039:0:9522:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788535799.444050:0:9522:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9005baf299c0 local copy 10000000:01000000:2.0:1788535799.444054:0:9522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788535799.444099:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.444111:0:9522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.444120:0:9522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.444138:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304064:0@lo:101: 00000100:00100000:2.0:1788535799.444218:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.444261:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535799.444501:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569304064 00000100:00100000:3.0:1788535799.444508:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569304064 00000100:00100000:3.0:1788535799.444553:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788535799.444561:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+14:9522:x1875415569304064:12345-0@lo:101: 00010000:00010000:3.0:1788535799.444572:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535799.444585:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc2f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc2f2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.444606:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc2f2 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.444616:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc2f2 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.444624:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030c00, rc 0) 00000100:00100000:3.0:1788535799.444661:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304064:12345-0@lo:101: Request processed in 101us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.444676:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788535799.444776:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304064:0@lo:101: 00010000:00010000:2.0:1788535799.444790:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.444800:0:9522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.444910:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304192:0@lo:501: 00000100:00100000:2.0:1788535799.444937:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.444958:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535799.445003:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569304192 00000100:00100000:1.0:1788535799.445008:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569304192 00000100:00100000:1.0:1788535799.445039:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788535799.445046:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304192:12345-0@lo:501: 00000100:00100000:1.0:1788535799.445116:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304192:12345-0@lo:501: Request processed in 70us (178us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788535799.445122:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788535799.445517:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304192:0@lo:501: 10000000:01000000:2.0:1788535799.445530:0:9522:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788535799.445548:0:9522:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788535799.445553:0:9522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.445561:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.445569:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.445590:0:9522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788535799.445613:0:9522:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff900485fef800 10000000:01000000:2.0:1788535799.445618:0:9522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788535799.445623:0:9522:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788535799.445626:0:9522:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788535799.445630:0:9522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788535799.445633:0:9522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788535799.445651:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.445658:0:9522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.445667:0:9522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.445691:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304320:0@lo:101: 00000100:00100000:2.0:1788535799.445724:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.445753:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135300 going to sleep for 11 seconds 00010000:00010000:3.0:1788535799.445794:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535799.445800:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.445807:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461800 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:3.0:1788535799.445811:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.445819:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788535799.445826:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535799.445832:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788535799.445851:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.445857:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788535799.445885:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.445891:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e461800/0xe79af2f39bbdc2f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe79af2f39bbdc2f9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.445904:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535799.445905:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535799.445907:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535799.445949:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569304448:0@lo:103: 00000100:00100000:0.0:1788535799.445982:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535799.446085:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569304448 00000100:00100000:3.0:1788535799.446097:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569304448 00000100:00100000:3.0:1788535799.446140:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535799.446177:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+15:3663:x1875415569304448:12345-0@lo:103: 00010000:00010000:3.0:1788535799.446188:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535799.446201:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc2f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc2f2 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535799.446215:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535799.446248:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+14:3663:x1875415569304448:12345-0@lo:103: Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.446254:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788535799.446382:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569304448:0@lo:103: 00000100:00100000:1.0:1788535799.446702:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569304320 00000100:00100000:1.0:1788535799.446708:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569304320 00000100:00100000:1.0:1788535799.446742:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788535799.446750:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+14:9522:x1875415569304320:12345-0@lo:101: 00010000:00010000:1.0:1788535799.446758:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535799.446772:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc300 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.446790:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc300 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.446800:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc300 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.446807:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50400, rc 0) 00000100:00100000:1.0:1788535799.446849:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304320:12345-0@lo:101: Request processed in 99us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535799.446854:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788535799.447331:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304320:0@lo:101: 00010000:00010000:2.0:1788535799.447349:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.447359:0:9522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535799.447458:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304576:0@lo:501: 00000100:00100000:2.0:1788535799.447494:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.447528:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135300 going to sleep for 11 seconds 00000100:00100000:1.0:1788535799.447801:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569304576 00000100:00100000:1.0:1788535799.447806:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569304576 00000100:00100000:1.0:1788535799.447844:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788535799.447852:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304576:12345-0@lo:501: 00000100:00100000:1.0:1788535799.447966:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304576:12345-0@lo:501: Request processed in 114us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535799.447975:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788535799.448068:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304576:0@lo:501: 00000100:00100000:0.0:1788535799.448100:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304704:0@lo:503: 00000100:00100000:0.0:1788535799.448176:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535799.448196:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900481cfac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535799.448632:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569304704 00000100:00100000:1.0:1788535799.448638:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569304704 00000100:00100000:1.0:1788535799.448673:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788535799.448688:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304704:12345-0@lo:503: 00000100:00100000:1.0:1788535799.448797:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304704:12345-0@lo:503: Request processed in 117us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535799.448804:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788535799.449069:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304704:0@lo:503: 00000040:00080000:0.0:1788535799.449335:0:9522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788535799.449401:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304832:0@lo:502: 00000100:00100000:0.0:1788535799.449445:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535799.449470:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900481cfac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535799.449673:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569304832 00000100:00100000:1.0:1788535799.449687:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569304832 00000100:00100000:1.0:1788535799.449723:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788535799.449730:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304832:12345-0@lo:502: 00000100:00100000:1.0:1788535799.449815:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304832:12345-0@lo:502: Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535799.449822:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788535799.449905:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304832:0@lo:502: 00000040:00080000:0.0:1788535799.450121:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788535799.450349:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788535799.450374:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788535799.450392:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788535799.450405:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788535799.450417:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788535799.450443:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304960:0@lo:502: 00000100:00100000:1.0:1788535799.450485:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535799.450516:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788535799.450568:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569304960 00000100:00100000:3.0:1788535799.450574:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569304960 00000100:00100000:3.0:1788535799.450606:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788535799.450614:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304960:12345-0@lo:502: 00000100:00100000:3.0:1788535799.450727:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569304960:12345-0@lo:502: Request processed in 114us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.450734:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788535799.450884:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569304960:0@lo:502: 00000040:00080000:0.0:1788535799.450923:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788535799.450938:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1788535799.452311:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788535799.452322:0:9534:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788535799.452328:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535799.452330:0:9534:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788535799.452336:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788535799.452350:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90059e5d4d40) 00000020:00000080:0.0:1788535799.452379:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788535799.452385:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788535799.452449:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900485fef800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788535799.452457:0:9534:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788535799.452462:0:9534:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe79af2f39bbdc315 00010000:00010000:2.0:1788535799.461545:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788535799.461815:0:9534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788535799.467984:0:9534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788535799.468411:0:9534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788535799.475534:0:9534:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788535799.475934:0:9534:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788535799.486127:0:9534:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788535799.494691:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788535799.494703:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535799.494709:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535799.494711:0:9534:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788535799.494714:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535799.494718:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535799.494719:0:9534:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788535799.494722:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788535799.494724:0:9534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788535799.494747:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535799.494749:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535799.494750:0:9534:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788535799.494753:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788535799.494946:0:9522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788535799.494977:0:9522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788535799.494998:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.495010:0:9522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535799.495018:0:9522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900485fef800 from 1 10000000:01000000:0.0:1788535799.495020:0:9522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788535799.495053:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.495060:0:9522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.495070:0:9522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.495092:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305088:0@lo:101: 00000100:00100000:0.0:1788535799.495176:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535799.495224:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900481cfad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535799.495460:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569305088 00000100:00100000:2.0:1788535799.495469:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569305088 00000100:00100000:2.0:1788535799.495505:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788535799.495513:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:9522:x1875415569305088:12345-0@lo:101: 00010000:00010000:2.0:1788535799.495525:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535799.495542:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc31c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.495562:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc31c expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.495572:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc31c expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.495581:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461400, rc 0) 00000100:00100000:2.0:1788535799.495616:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305088:12345-0@lo:101: Request processed in 103us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.495621:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788535799.495743:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305088:0@lo:101: 00010000:00010000:0.0:1788535799.495756:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.495765:0:9522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.495898:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305216:0@lo:501: 00000100:00100000:0.0:1788535799.495922:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535799.495946:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900481cfad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535799.495988:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569305216 00000100:00100000:2.0:1788535799.495992:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569305216 00000100:00100000:2.0:1788535799.496020:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788535799.496026:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305216:12345-0@lo:501: 00000100:00100000:2.0:1788535799.496166:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305216:12345-0@lo:501: Request processed in 120us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.496173:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788535799.498187:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305216:0@lo:501: 00000100:00100000:1.0:1788535799.498241:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305344:0@lo:503: 00000100:00100000:1.0:1788535799.498304:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535799.498336:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788535799.498415:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569305344 00000100:00100000:0.0:1788535799.498422:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569305344 00000100:00100000:0.0:1788535799.498473:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788535799.498482:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305344:12345-0@lo:503: 00000100:00100000:0.0:1788535799.498584:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305344:12345-0@lo:503: Request processed in 103us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.498591:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788535799.498638:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305344:0@lo:503: 00000040:00080000:0.0:1788535799.498901:0:9522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788535799.498968:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305472:0@lo:502: 00000100:00100000:0.0:1788535799.499003:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535799.499028:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569305472 00000100:00100000:0.0:1788535799.499032:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569305472 00000100:00100000:0.0:1788535799.499057:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788535799.499063:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305472:12345-0@lo:502: 00000100:00100000:0.0:1788535799.499176:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305472:12345-0@lo:502: Request processed in 83us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.499183:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788535799.499229:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900481cfa480 going to sleep for 11 seconds 00000100:00100000:0.0:1788535799.499242:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305472:0@lo:502: 00000040:00080000:0.0:1788535799.499406:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788535799.499431:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788535799.499450:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305600:0@lo:502: 00000100:00100000:0.0:1788535799.499483:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535799.499503:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569305600 00000100:00100000:0.0:1788535799.499507:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569305600 00000100:00100000:0.0:1788535799.499527:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788535799.499533:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305600:12345-0@lo:502: 00000100:00100000:0.0:1788535799.499593:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305600:12345-0@lo:502: Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.499599:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788535799.499627:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900481cfa480 going to sleep for 11 seconds 00000100:00100000:0.0:1788535799.499638:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305600:0@lo:502: 00000040:00080000:0.0:1788535799.499674:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788535799.499693:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788535799.510942:0:9538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535799.510956:0:9538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535799.510959:0:9538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788535799.510969:0:9538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff900485fef800 00000020:00000080:1.0:1788535799.510972:0:9538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788535799.510996:0:9538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535799.510999:0:9538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535799.511000:0:9538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788535799.511003:0:9538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788535799.511464:0:9522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788535799.511497:0:9522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788535799.511523:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.511536:0:9522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535799.511582:0:9522:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788535799.511585:0:9522:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff900485fef800 10000000:01000000:1.0:1788535799.511588:0:9522:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff900485fef800 10000000:01000000:1.0:1788535799.511593:0:9522:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788535799.511598:0:9522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff900485fef800 from 1 10000000:01000000:1.0:1788535799.511601:0:9522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788535799.511637:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.511646:0:9522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.511657:0:9522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535799.511692:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305728:0@lo:101: 00000100:00100000:1.0:1788535799.511762:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535799.511817:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535799.518258:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569305728 00000100:00100000:0.0:1788535799.518272:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569305728 00000100:00100000:0.0:1788535799.518335:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788535799.518345:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:9522:x1875415569305728:12345-0@lo:101: 00010000:00010000:0.0:1788535799.518361:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535799.518380:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc32a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.518425:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc32a expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.518437:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc32a expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.518447:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455a00, rc 0) 00000100:00100000:0.0:1788535799.518512:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569305728:12345-0@lo:101: Request processed in 169us (6749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.518518:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788535799.518910:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305728:0@lo:101: 00010000:00010000:1.0:1788535799.518939:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.518948:0:9522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535799.519048:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305856:0@lo:501: 00000100:00100000:1.0:1788535799.519080:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535799.520446:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535799.521137:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569305856 00000100:00100000:2.0:1788535799.521165:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569305856 00000100:00100000:0.0:1788535799.521426:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788535799.521437:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569305856:12345-0@lo:501: 00000100:00100000:0.0:1788535799.521600:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569305856:12345-0@lo:501: Request processed in 165us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.521607:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788535799.521955:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305856:0@lo:501: 00000100:00100000:1.0:1788535799.521997:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305984:0@lo:503: 00000100:00100000:1.0:1788535799.522043:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535799.522075:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535799.522754:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569305984 00000100:00100000:2.0:1788535799.522761:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569305984 00000100:00100000:2.0:1788535799.522878:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788535799.522888:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569305984:12345-0@lo:503: 00000100:00100000:2.0:1788535799.523006:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569305984:12345-0@lo:503: Request processed in 120us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.523013:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788535799.523084:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569305984:0@lo:503: 00000040:00080000:1.0:1788535799.523333:0:9522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788535799.523406:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569306112:0@lo:502: 00000100:00100000:1.0:1788535799.523449:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535799.530175:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535799.530873:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569306112 00000100:00100000:0.0:1788535799.530883:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569306112 00000100:00100000:0.0:1788535799.530934:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788535799.530944:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569306112:12345-0@lo:502: 00000100:00100000:0.0:1788535799.531110:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569306112:12345-0@lo:502: Request processed in 166us (7660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.531119:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788535799.531440:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569306112:0@lo:502: 00000040:00080000:1.0:1788535799.531695:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788535799.531722:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788535799.531734:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788535799.531744:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788535799.531755:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788535799.531765:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788535799.531775:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788535799.531786:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788535799.531879:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788535799.531894:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788535799.531908:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788535799.531922:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788535799.531934:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788535799.531946:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788535799.531960:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788535799.531972:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788535799.531986:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788535799.532001:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788535799.532012:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788535799.532022:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788535799.532033:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788535799.532044:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788535799.532069:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788535799.532083:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788535799.532094:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788535799.532105:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788535799.532117:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788535799.532129:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788535799.532140:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788535799.532192:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788535799.532360:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788535799.532379:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788535799.532391:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788535799.532403:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788535799.532417:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788535799.532430:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788535799.532444:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1788535799.532458:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788535799.532485:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1788535799.532502:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1788535799.532517:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1788535799.532541:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1788535799.532554:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1788535799.532566:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1788535799.532576:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1788535799.532586:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1788535799.532622:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569306240:0@lo:502: 00000100:00100000:1.0:1788535799.532676:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535799.532814:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535799.536735:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569306240 00000100:00100000:2.0:1788535799.536750:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569306240 00000100:00100000:3.0:1788535799.538117:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788535799.538129:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569306240:12345-0@lo:502: 00000100:00100000:3.0:1788535799.538450:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569306240:12345-0@lo:502: Request processed in 323us (5773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535799.538459:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788535799.538575:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569306240:0@lo:502: 00000040:00080000:1.0:1788535799.538652:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1788535799.538666:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788535799.539327:0:9539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788535799.539344:0:9539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90059fa90000) 00000020:00000080:1.0:1788535799.539370:0:9539:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788535799.539464:0:9539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900485fef800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788535799.539468:0:9539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff900485fef800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788535799.539472:0:9539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff900485fef800 3 00010000:00080000:1.0:1788535799.539504:0:9539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90059fa9a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788535799.541658:0:9539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788535799.545761:0:9539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788535799.545812:0:9539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788535799.545825:0:9539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe79af2f39bbdc33f 00000100:00080000:1.0:1788535799.545835:0:9539:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788535799.545841:0:9539:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90059fa9a000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788535799.545947:0:9539:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900485d90000 x1875415569306368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788535799.546128:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3659:1875415569306368:0@lo:38: 00000100:00100000:0.0:1788535799.546297:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788535799.546549:0:9539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788535799.546613:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569306368 00000100:00100000:0.0:1788535799.546620:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569306368 00000100:00100000:0.0:1788535799.546700:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788535799.546706:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1875415569306368:12345-0@lo:38: 00010000:00080000:0.0:1788535799.546730:0:6535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:0.0:1788535799.546759:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe79af2f39bbdc346 00000004:00100000:0.0:1788535799.546773:0:6535:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788535799.546803:0:6535:0:(import.c:65:import_set_state_nolock()) ffff900487545000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535799.546930:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875415569306368:12345-0@lo:38: Request processed in 145us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.546939:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788535799.547021:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900485d90000 x1875415569306368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788535809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535799.547031:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788535799.547038:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788535799.547045:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788535799.547048:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788535799.547051:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059fa9a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788535799.547056:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3659:1875415569306368:0@lo:38: 00000100:00100000:2.0:1788535799.548429:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569306496:0@lo:400: 00000100:00100000:2.0:1788535799.548485:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.548517:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569307008:0@lo:400: 00000100:00100000:2.0:1788535799.548538:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.548560:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788535799.548566:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569306624:0@lo:400: 00000100:00100000:2.0:1788535799.548590:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.548609:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569307136:0@lo:400: 00000100:00100000:2.0:1788535799.548628:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.548655:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569306752:0@lo:400: 00000100:00100000:2.0:1788535799.548677:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.548703:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569307264:0@lo:400: 00000100:00100000:2.0:1788535799.548725:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.548744:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788535799.548749:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569306880:0@lo:400: 00000100:00100000:2.0:1788535799.548769:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.548784:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569307392:0@lo:400: 00000100:00100000:2.0:1788535799.548819:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.548848:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569306496 00000100:00100000:2.0:1788535799.548854:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569306496 00000100:00100000:2.0:1788535799.548887:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569307008 00000100:00100000:2.0:1788535799.548890:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569307008 00000100:00100000:2.0:1788535799.548913:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569307136 00000100:00100000:2.0:1788535799.548916:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569307136 00000100:00100000:2.0:1788535799.548928:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569306752 00000100:00100000:2.0:1788535799.548930:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569306752 00000100:00100000:2.0:1788535799.548957:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788535799.548964:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569306496:12345-0@lo:400: 00000100:00100000:2.0:1788535799.549010:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569306496:12345-0@lo:400: Request processed in 47us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.549017:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788535799.549033:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788535799.549039:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569307008:12345-0@lo:400: 00000100:00100000:2.0:1788535799.549062:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569307008:12345-0@lo:400: Request processed in 24us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.549068:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788535799.549078:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788535799.549084:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569307136:12345-0@lo:400: 00000100:00100000:2.0:1788535799.549108:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569307136:12345-0@lo:400: Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.549113:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788535799.549124:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788535799.549129:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569306752:12345-0@lo:400: 00000100:00100000:2.0:1788535799.549176:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569306752:12345-0@lo:400: Request processed in 46us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.549181:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788535799.549199:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569306624 00000100:00100000:2.0:1788535799.549202:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569306624 00000100:00100000:2.0:1788535799.549218:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569306880 00000100:00100000:2.0:1788535799.549221:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569306880 00000100:00100000:2.0:1788535799.549232:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788535799.549237:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569306624:12345-0@lo:400: 00000100:00100000:2.0:1788535799.549267:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569306624:12345-0@lo:400: Request processed in 29us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.549280:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788535799.549292:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788535799.549298:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569306880:12345-0@lo:400: 00000100:00100000:2.0:1788535799.549326:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569306880:12345-0@lo:400: Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.549331:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788535799.549348:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569307264 00000100:00100000:2.0:1788535799.549352:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569307264 00000100:00100000:2.0:1788535799.549375:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569307392 00000100:00100000:2.0:1788535799.549377:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569307392 00000100:00100000:2.0:1788535799.549390:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535799.549395:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569307264:12345-0@lo:400: 00000100:00100000:2.0:1788535799.549423:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569307264:12345-0@lo:400: Request processed in 28us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.549429:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788535799.549440:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788535799.549446:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569307392:12345-0@lo:400: 00000100:00100000:2.0:1788535799.549470:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569307392:12345-0@lo:400: Request processed in 24us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.549476:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788535799.549495:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535799.549500:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535799.549502:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535799.549532:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569306880:0@lo:400: 00010000:00080000:2.0:1788535799.549546:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9005894af100 x1875415569307392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535799.549569:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569307392:0@lo:400: 00010000:00080000:2.0:1788535799.549582:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900485d91f80 x1875415569306752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535799.549589:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569306752:0@lo:400: 00010000:00080000:2.0:1788535799.549598:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900485d90e00 x1875415569307264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535799.549606:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569307264:0@lo:400: 00000100:00100000:2.0:1788535799.549637:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569306624:0@lo:400: 00010000:00080000:2.0:1788535799.549647:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900485d92680 x1875415569307136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535799.549655:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569307136:0@lo:400: 00010000:00080000:2.0:1788535799.549664:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900485d90a80 x1875415569306496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535799.549672:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569306496:0@lo:400: 00010000:00080000:2.0:1788535799.549694:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900485d90000 x1875415569307008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535799.549702:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569307008:0@lo:400: 00000020:01000004:3.0:1788535799.551996:0:9539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788535799.552013:0:9539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90059e1b4d40) 00000020:00000080:3.0:1788535799.552040:0:9539:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1788535799.552128:0:9539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900485fef800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788535799.552132:0:9539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff900485fef800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788535799.552134:0:9539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff900485fef800 3 00010000:00080000:3.0:1788535799.552179:0:9539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9005b7b0f000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.113@tcp at head 00000100:00100000:2.0:1788535799.553630:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9541:1875415569307520:0@lo:901: 00000100:00100000:2.0:1788535799.553716:0:9541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.553752:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff900588f74900 going to sleep for 11 seconds 00000100:00100000:1.0:1788535799.555601:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569307520 00000100:00100000:1.0:1788535799.555614:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569307520 00000100:00100000:1.0:1788535799.555697:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788535799.555707:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9541:x1875415569307520:12345-0@lo:901: 00000100:00100000:1.0:1788535799.555897:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9541:x1875415569307520:12345-0@lo:901: Request processed in 192us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535799.555905:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788535799.558018:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788535799.558078:0:9541:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900481cfdf80 x1875415569307520/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788535815 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535799.558093:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9541:1875415569307520:0@lo:901: 00010000:00010000:3.0:1788535799.558910:0:9539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1788535799.559101:0:9539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788535799.559141:0:9539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788535799.559169:0:9539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe79af2f39bbdc354 00000100:00080000:3.0:1788535799.559178:0:9539:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788535799.559184:0:9539:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9005b7b0f000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788535799.561016:0:9539:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900487466680 x1875415569307648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788535799.561041:0:9539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1788535799.561987:0:9539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788535799.563005:0:9522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788535799.563040:0:9522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788535799.563061:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535799.563074:0:9522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788535799.563125:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788535799.563127:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788535799.563129:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535799.563130:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535799.563131:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535799.563133:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535799.563134:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535799.563136:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535799.563137:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535799.563139:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535799.563141:0:9522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788535799.563161:0:9522:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788535799.563164:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788535799.563165:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788535799.563167:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535799.563168:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535799.563169:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535799.563170:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535799.563171:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535799.563182:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535799.563183:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535799.563184:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535799.563185:0:9522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788535799.563212:0:9522:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788535799.563236:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569307776:0@lo:253: 00000100:00100000:2.0:1788535799.563303:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535799.563342:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569307776 00000100:00100000:2.0:1788535799.563347:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569307776 00000100:00100000:2.0:1788535799.563387:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788535799.563395:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569307776:12345-0@lo:253: 20000000:01000000:2.0:1788535799.563418:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788535799.563432:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788535799.563547:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535799.566857:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3659:1875415569307648:0@lo:38: 00000100:00100000:0.0:1788535799.566942:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535799.567316:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569307648 00000100:00100000:1.0:1788535799.567325:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569307648 00000100:00100000:1.0:1788535799.567364:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788535799.567371:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1875415569307648:12345-0@lo:38: 00010000:00080000:1.0:1788535799.567399:0:6534:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:1.0:1788535799.567432:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe79af2f39bbdc35b 00000004:00100000:1.0:1788535799.567446:0:6534:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788535799.567476:0:6534:0:(import.c:65:import_set_state_nolock()) ffff90048680b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535799.567528:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875415569307648:12345-0@lo:38: Request processed in 156us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535799.567534:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788535799.567674:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487466680 x1875415569307648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788535809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535799.567695:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788535799.567702:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788535799.567710:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788535799.567714:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788535799.567723:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005b7b0f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788535799.567729:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3659:1875415569307648:0@lo:38: 20000000:01000000:2.0:1788535799.572964:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788535799.572989:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788535799.573256:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:9522:x1875415569307776:12345-0@lo:253: Request processed in 9855us (9947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535799.573268:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788535799.573339:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:89006101-b582-4041-a87b-c8866dc8e13c:9522:1875415569307776:0@lo:253: 20000000:01000000:1.0:1788535799.573358:0:6549:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788535799.573363:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788535799.573383:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.573399:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc251 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.573407:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc297 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.573416:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.573464:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc297 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535799.573476:0:9522:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788535799.573479:0:9522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:1.0:1788535799.573479:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc297 expref: 16 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788535799.573481:0:9522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788535799.573482:0:9522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788535799.573483:0:9522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788535799.573485:0:9522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788535799.573486:0:9522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788535799.573487:0:9522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788535799.573488:0:9522:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788535799.573489:0:9522:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788535799.573491:0:9522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788535799.573492:0:9522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788535799.573492:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569307904:0@lo:104: 00000020:02000000:2.0:1788535799.573507:0:9522:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788535799.573523:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535799.573570:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc251 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.573579:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc251 expref: 16 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535799.573586:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569308032:0@lo:104: 00000100:00100000:1.0:1788535799.573605:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535799.573626:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535799.573669:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569307904 00000100:00100000:0.0:1788535799.573675:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569307904 00000100:00100000:0.0:1788535799.573716:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569308032 00000100:00100000:0.0:1788535799.573719:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569308032 00000100:00100000:0.0:1788535799.573733:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788535799.573741:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:6549:x1875415569307904:12345-0@lo:104: 00010000:00010000:0.0:1788535799.573753:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.573802:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788535799.573808:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:6549:x1875415569307904:12345-0@lo:104: Request processed in 69us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.573814:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788535799.573827:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788535799.573833:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6549:x1875415569308032:12345-0@lo:104: 00010000:00010000:0.0:1788535799.573840:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.573874:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788535799.573879:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:6549:x1875415569308032:12345-0@lo:104: Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.573884:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788535799.573899:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788535799.573904:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.573923:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454600 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535799.573927:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.573935:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535799.573942:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535799.573948:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535799.573974:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.573981:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535799.573997:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.574005:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e454600/0xe79af2f39bbdc297 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc29e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.574015:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535799.574019:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.574025:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e000 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535799.574028:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.574045:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535799.574052:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535799.574057:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535799.574071:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.574076:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535799.574082:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.574088:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc251 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc258 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.574101:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535799.574102:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535799.574104:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535799.574110:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535799.574126:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569308160:0@lo:103: 00000100:00100000:0.0:1788535799.574177:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535799.574197:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535799.575325:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569308288:0@lo:103: 00000100:00100000:0.0:1788535799.575372:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535799.575420:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569308160 00000100:00100000:0.0:1788535799.575426:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569308160 00010000:00010000:0.0:1788535799.575449:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc297 expref: 17 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.575481:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569308288 00000100:00100000:0.0:1788535799.575485:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569308288 00010000:00010000:0.0:1788535799.575498:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc251 expref: 18 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535799.575511:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788535799.575518:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+18:3660:x1875415569308160:12345-0@lo:103: 00010000:00010000:0.0:1788535799.575541:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535799.575547:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc297 expref: 18 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575559:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc297 expref: 18 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575575:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535799.575607:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+18:3660:x1875415569308160:12345-0@lo:103: Request processed in 89us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.575613:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788535799.575628:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788535799.575634:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+17:3660:x1875415569308288:12345-0@lo:103: 00010000:00010000:0.0:1788535799.575642:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535799.575646:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc251 expref: 17 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575655:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc251 expref: 17 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575666:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575689:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788535799.575704:0:6519:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011502205s 00010000:00010000:0.0:1788535799.575709:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575716:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575724:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575731:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575737:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788535799.575741:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575749:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575757:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535799.575766:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535799.575790:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+17:3660:x1875415569308288:12345-0@lo:103: Request processed in 156us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535799.575796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788535799.575851:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569308288:0@lo:103: 00000100:00100000:0.0:1788535799.575861:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569308160:0@lo:103: 00010000:00010000:1.0:1788535799.575952:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e454200/0xe79af2f39bbdc29e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc297 expref: 16 pid: 6528 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535799.575964:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569307904:0@lo:104: 00010000:00010000:1.0:1788535799.575974:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e460600/0xe79af2f39bbdc258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc251 expref: 15 pid: 6526 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535799.575981:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875415569308032:0@lo:104: 00010000:00010000:1.0:1788535799.575994:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.576014:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.576021:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535799.576027:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc362 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788535799.584426:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788535799.584591:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788535799.584853:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788535799.585002:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788535799.585260:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788535799.585457:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788535799.593962:0:9522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788535799.603765:0:9522:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788535799.603775:0:9522:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788535799.603870:0:9522:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788535799.603912:0:9522:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788535799.603930:0:9522:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788535799.603947:0:9522:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788535799.604672:0:9522:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788535799.605056:0:9522:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788535799.980296:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535800.238252:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569308416:0@lo:13: 00000100:00100000:3.0:1788535800.238335:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535800.238394:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569308416 00000100:00100000:0.0:1788535800.238402:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569308416 00000100:00100000:0.0:1788535800.238458:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788535800.238468:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569308416:12345-0@lo:13: 00002000:00000024:0.0:1788535800.238507:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535800.238720:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569308416:12345-0@lo:13: Request processed in 252us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535800.238727:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788535800.238796:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e70df80 x1875415569308416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535800.238824:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569308416:0@lo:13: 00000100:00100000:0.0:1788535800.240628:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569308544:0@lo:13: 00000100:00100000:0.0:1788535800.240694:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535800.240829:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569308544 00000100:00100000:1.0:1788535800.240836:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569308544 00000100:00100000:1.0:1788535800.240950:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788535800.240960:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569308544:12345-0@lo:13: 00002000:00000024:1.0:1788535800.240980:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535800.241035:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569308544:12345-0@lo:13: Request processed in 77us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535800.241042:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788535800.244438:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ac700 x1875415569308544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535800.244464:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569308544:0@lo:13: 00000020:00000004:0.0:1788535800.511287:0:9595:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788535800.511477:0:9595:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788535800.751570:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569308672:0@lo:41: 00000100:00100000:0.0:1788535800.751634:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535800.753801:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569308672 00000100:00100000:0.0:1788535800.753816:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569308672 00000100:00100000:0.0:1788535800.753868:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788535800.753877:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569308672:12345-0@lo:41: 00000004:00000024:0.0:1788535800.753909:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788535800.753985:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569308672:12345-0@lo:41: Request processed in 109us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535800.754773:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788535800.754839:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569308672:0@lo:41: 00010000:00010000:0.0:1788535801.004384:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535801.260877:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569308800:0@lo:41: 00000100:00100000:3.0:1788535801.260966:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535801.261209:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569308800 00000100:00100000:2.0:1788535801.261219:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569308800 00000100:00100000:2.0:1788535801.261282:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788535801.261294:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569308800:12345-0@lo:41: 00000004:00000024:2.0:1788535801.261332:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788535801.261394:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569308800:12345-0@lo:41: Request processed in 103us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535801.261402:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788535801.261452:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569308800:0@lo:41: 00010000:00010000:2.0:1788535802.031979:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535803.054306:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535804.077563:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535804.844940:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569309184:0@lo:400: 00000100:00100000:1.0:1788535804.845020:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535804.845081:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569308928:0@lo:400: 00000100:00100000:2.0:1788535804.845118:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535804.845195:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569309440:0@lo:400: 00000100:00100000:2.0:1788535804.845224:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569309056:0@lo:400: 00000100:00100000:2.0:1788535804.845249:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535804.845269:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569309568:0@lo:400: 00000100:00100000:2.0:1788535804.845290:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535804.845306:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569310080:0@lo:400: 00000100:00100000:2.0:1788535804.845325:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535804.845355:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569309312:0@lo:400: 00000100:00100000:2.0:1788535804.845379:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535804.845391:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569309824:0@lo:400: 00000100:00100000:2.0:1788535804.845411:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535804.845440:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569309056 00000100:00100000:2.0:1788535804.845453:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569309056 00000100:00100000:2.0:1788535804.845487:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569309568 00000100:00100000:2.0:1788535804.845490:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569309568 00000100:00100000:2.0:1788535804.845511:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569310080 00000100:00100000:2.0:1788535804.845514:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569310080 00000100:00100000:2.0:1788535804.845525:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569309312 00000100:00100000:2.0:1788535804.845528:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569309312 00000100:00100000:2.0:1788535804.845544:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788535804.845551:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569309056:12345-0@lo:400: 00000100:00100000:2.0:1788535804.845598:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569309056:12345-0@lo:400: Request processed in 46us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535804.845604:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788535804.845622:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788535804.845628:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569309568:12345-0@lo:400: 00000100:00100000:2.0:1788535804.845666:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569309568:12345-0@lo:400: Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535804.845672:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788535804.845726:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569309696:0@lo:400: 00000100:00100000:1.0:1788535804.845750:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535804.845772:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569310208:0@lo:400: 00000100:00100000:1.0:1788535804.845795:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535804.845823:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569308928 00000100:00100000:3.0:1788535804.845828:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569308928 00000100:00100000:3.0:1788535804.845854:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788535804.845860:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:3662:x1875415569308928:12345-0@lo:400: 00000100:00100000:3.0:1788535804.845889:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+15:3662:x1875415569308928:12345-0@lo:400: Request processed in 29us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535804.845895:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788535804.845920:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569309696 00000100:00100000:3.0:1788535804.845923:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569309696 00000100:00100000:3.0:1788535804.845939:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569310208 00000100:00100000:3.0:1788535804.845941:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569310208 00000100:00100000:3.0:1788535804.845954:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788535804.845959:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569310080:12345-0@lo:400: 00000100:00100000:3.0:1788535804.845986:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569310080:12345-0@lo:400: Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535804.845992:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788535804.846003:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788535804.846009:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569309312:12345-0@lo:400: 00000100:00100000:3.0:1788535804.846035:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569309312:12345-0@lo:400: Request processed in 27us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535804.846041:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788535804.846052:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788535804.846065:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569309696:12345-0@lo:400: 00000100:00100000:3.0:1788535804.846097:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569309696:12345-0@lo:400: Request processed in 32us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535804.846103:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788535804.846114:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788535804.846120:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569310208:12345-0@lo:400: 00000100:00100000:3.0:1788535804.846144:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569310208:12345-0@lo:400: Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535804.846166:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788535804.846207:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e01b100 x1875415569309696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535804.846220:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569309696:0@lo:400: 00010000:00080000:3.0:1788535804.846233:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad1c00 x1875415569310208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535804.846242:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569310208:0@lo:400: 00000100:00080000:3.0:1788535804.846355:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535804.846359:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535804.846369:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569309824 00000100:00100000:3.0:1788535804.846372:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569309824 00000100:00100000:3.0:1788535804.846402:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788535804.846409:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569309824:12345-0@lo:400: 00000100:00100000:3.0:1788535804.846438:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569309824:12345-0@lo:400: Request processed in 31us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535804.846444:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788535804.846461:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788535804.846477:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894aed80 x1875415569309056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535804.846494:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569309056:0@lo:400: 00010000:00080000:3.0:1788535804.846508:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e018e00 x1875415569309568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535804.846515:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569309568:0@lo:400: 00010000:00080000:3.0:1788535804.846527:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e018000 x1875415569310080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535804.846535:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569310080:0@lo:400: 00000100:00100000:3.0:1788535804.846575:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788535804.846637:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894af100 x1875415569309312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535804.846658:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569309312:0@lo:400: 00010000:00080000:2.0:1788535804.846669:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e01ad80 x1875415569309824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535804.846676:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569309824:0@lo:400: 00000100:00100000:3.0:1788535804.850751:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569309952:0@lo:400: 00000100:00100000:3.0:1788535804.850827:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535804.850877:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569308928:0@lo:400: 00000100:00100000:3.0:1788535804.850921:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569309952 00000100:00100000:3.0:1788535804.850927:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569309952 00000100:00100000:3.0:1788535804.850976:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788535804.850985:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569309952:12345-0@lo:400: 00000100:00100000:3.0:1788535804.851040:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569309952:12345-0@lo:400: Request processed in 56us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535804.851048:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788535804.851069:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788535804.851092:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e019500 x1875415569309952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535804.851104:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569309952:0@lo:400: 00000100:00100000:2.0:1788535804.851355:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569309184 00000100:00100000:2.0:1788535804.851361:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569309184 00000100:00100000:2.0:1788535804.851386:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569309440 00000100:00100000:2.0:1788535804.851389:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569309440 00000100:00100000:2.0:1788535804.851404:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788535804.851425:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569309184:12345-0@lo:400: 00000100:00100000:2.0:1788535804.851526:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569309184:12345-0@lo:400: Request processed in 101us (6505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535804.851532:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788535804.851548:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788535804.851555:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569309440:12345-0@lo:400: 00000100:00100000:2.0:1788535804.851619:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569309440:12345-0@lo:400: Request processed in 65us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535804.851625:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788535804.851827:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569309184:0@lo:400: 00000100:00100000:3.0:1788535804.851863:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569309440:0@lo:400: 00010000:00010000:0.0:1788535805.105851:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535805.356325:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535805.356350:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569310336:0@lo:13: 00000100:00100000:0.0:1788535805.356412:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535805.356442:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569310336 00000100:00100000:1.0:1788535805.356449:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569310336 00000100:00100000:1.0:1788535805.356498:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788535805.356508:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569310336:12345-0@lo:13: 00002000:00000024:1.0:1788535805.356543:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535805.356595:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569310336:12345-0@lo:13: Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535805.356602:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788535805.356618:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e70e680 x1875415569310336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535805.356637:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569310336:0@lo:13: 00000100:00100000:2.0:1788535805.356927:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569310464:0@lo:13: 00000100:00100000:2.0:1788535805.356958:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535805.357431:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569310464 00000100:00100000:1.0:1788535805.357438:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569310464 00000100:00100000:1.0:1788535805.357467:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788535805.357475:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569310464:12345-0@lo:13: 00002000:00000024:1.0:1788535805.357488:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535805.358715:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569310464:12345-0@lo:13: Request processed in 1234us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535805.358726:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788535805.358841:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e70f100 x1875415569310464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535805.358861:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569310464:0@lo:13: 00000100:00100000:2.0:1788535805.872831:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535805.872858:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569310592:0@lo:41: 00000100:00100000:2.0:1788535805.872925:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535805.872997:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569310592 00000100:00100000:2.0:1788535805.873005:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569310592 00000100:00100000:2.0:1788535805.873052:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788535805.873060:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569310592:12345-0@lo:41: 00000004:00000024:2.0:1788535805.873092:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788535805.873137:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569310592:12345-0@lo:41: Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535805.873143:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788535805.873210:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569310592:0@lo:41: 00000001:02000400:3.0:1788535805.898419:0:9885:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788535806.131561:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535806.380930:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569310720:0@lo:41: 00000100:00100000:3.0:1788535806.381001:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535806.381511:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569310720 00000100:00100000:0.0:1788535806.381519:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569310720 00000100:00100000:0.0:1788535806.381569:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788535806.381577:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569310720:12345-0@lo:41: 00000004:00000024:0.0:1788535806.381610:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788535806.381671:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569310720:12345-0@lo:41: Request processed in 94us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535806.381678:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788535806.381873:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569310720:0@lo:41: 00000020:00000004:3.0:1788535806.685521:0:9937:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788535806.685787:0:9937:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788535807.151950:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535808.173901:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788535808.941059:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788535808.941068:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005893a3800 from 39 10000000:01000000:0.0:1788535808.941073:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788535808.941115:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535808.941128:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535808.941139:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535808.941193:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569310848:0@lo:101: 00000100:00100000:0.0:1788535808.941253:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535808.941310:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535808.941672:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569310848 00000100:00100000:3.0:1788535808.941692:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569310848 00000100:00100000:3.0:1788535808.941820:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788535808.941830:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569310848:12345-0@lo:101: 00010000:00010000:3.0:1788535808.941844:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535808.941858:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc369 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.941881:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc369 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.941894:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc369 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.941903:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030c00, rc 0) 00000100:00100000:3.0:1788535808.941963:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569310848:12345-0@lo:101: Request processed in 136us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.941970:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788535808.942024:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569310848:0@lo:101: 00010000:00010000:3.0:1788535808.942040:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535808.942048:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535808.942107:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487464700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569310976:0@lo:501: 00000100:00100000:3.0:1788535808.944295:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535808.944338:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788535808.945070:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569310976 00000100:00100000:2.0:1788535808.945080:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569310976 00000100:00100000:2.0:1788535808.945138:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788535808.945193:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569310976:12345-0@lo:501: 00000100:00100000:2.0:1788535808.945346:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569310976:12345-0@lo:501: Request processed in 156us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.945354:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788535808.945625:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487464700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569310976:0@lo:501: 00000100:00100000:3.0:1788535808.945672:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487464700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569311104:0@lo:503: 00000100:00100000:2.0:1788535808.946318:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.946358:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788535808.946453:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569311104 00000100:00100000:0.0:1788535808.946459:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569311104 00000100:00100000:0.0:1788535808.946499:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788535808.946507:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569311104:12345-0@lo:503: 00000100:00100000:0.0:1788535808.946718:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569311104:12345-0@lo:503: Request processed in 203us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.946796:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487464700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569311104:0@lo:503: 00000100:00100000:2.0:1788535808.947124:0:10008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10008:1875415569311232:0@lo:502: 00000100:00100000:2.0:1788535808.947198:0:10008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.947217:0:10008:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535808.947336:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569311232 00000100:00100000:1.0:1788535808.947342:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569311232 00000100:00100000:0.0:1788535808.947455:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788535808.955600:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788535808.955634:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:10008:x1875415569311232:12345-0@lo:502: 00000100:00100000:0.0:1788535808.955943:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:10008:x1875415569311232:12345-0@lo:502: Request processed in 318us (8733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535808.955952:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788535808.956239:0:10008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10008:1875415569311232:0@lo:502: 00000100:00100000:1.0:1788535808.956326:0:10008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10008:1875415569311360:0@lo:502: 00000100:00100000:1.0:1788535808.956372:0:10008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.956413:0:10008:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535808.958067:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569311360 00000100:00100000:2.0:1788535808.958081:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569311360 00000100:00100000:2.0:1788535808.958138:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788535808.958187:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:10008:x1875415569311360:12345-0@lo:502: 00000100:00100000:2.0:1788535808.958354:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:10008:x1875415569311360:12345-0@lo:502: Request processed in 169us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.958361:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788535808.958452:0:10008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10008:1875415569311360:0@lo:502: 00000040:00080000:1.0:1788535808.958852:0:10008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788535808.959078:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788535808.959106:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788535808.959116:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.959127:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535808.959244:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788535808.959245:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788535808.959247:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788535808.959276:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.959282:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.959288:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535808.959301:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569311488:0@lo:101: 00000100:00100000:2.0:1788535808.959335:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.959390:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17600 going to sleep for 11 seconds 00000100:00100000:1.0:1788535808.959414:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569311488 00000100:00100000:1.0:1788535808.959419:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569311488 00000100:00100000:1.0:1788535808.959473:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788535808.959479:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569311488:12345-0@lo:101: 00010000:00010000:1.0:1788535808.959487:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535808.959497:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc377 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.959523:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc377 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.959533:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc377 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.959541:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50a00, rc 0) 00000100:00100000:1.0:1788535808.959578:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569311488:12345-0@lo:101: Request processed in 99us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535808.959583:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788535808.959610:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569311488:0@lo:101: 00010000:00010000:1.0:1788535808.959635:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.959643:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535808.959694:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569311616:0@lo:501: 00000100:00100000:1.0:1788535808.959719:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.959770:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535808.959859:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569311616 00000100:00100000:2.0:1788535808.959863:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569311616 00000100:00100000:2.0:1788535808.959885:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788535808.959891:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569311616:12345-0@lo:501: 00000100:00100000:2.0:1788535808.960049:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569311616:12345-0@lo:501: Request processed in 157us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.960056:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788535808.960120:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569311616:0@lo:501: 00000100:00100000:1.0:1788535808.960216:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569311744:0@lo:503: 00000100:00100000:1.0:1788535808.960257:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.960315:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535808.960327:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569311744 00000100:00100000:1.0:1788535808.960330:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569311744 00000100:00100000:2.0:1788535808.960376:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788535808.960384:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569311744:12345-0@lo:503: 00000100:00100000:2.0:1788535808.960464:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569311744:12345-0@lo:503: Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.960470:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788535808.960550:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569311744:0@lo:503: 00000100:00100000:2.0:1788535808.964663:0:10009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10009:1875415569311872:0@lo:502: 00000100:00100000:2.0:1788535808.964821:0:10009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.964897:0:10009:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17900 going to sleep for 11 seconds 00000100:00100000:1.0:1788535808.967281:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569311872 00000100:00100000:1.0:1788535808.967293:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569311872 00000100:00100000:1.0:1788535808.967847:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788535808.967859:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:10009:x1875415569311872:12345-0@lo:502: 00000100:00100000:1.0:1788535808.968065:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:10009:x1875415569311872:12345-0@lo:502: Request processed in 208us (3316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535808.968073:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788535808.968740:0:10009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10009:1875415569311872:0@lo:502: 00000020:01000000:2.0:1788535808.968784:0:10009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535808.968793:0:10009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535808.968796:0:10009:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788535808.968803:0:10009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788535808.968805:0:10009:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788535808.968833:0:10009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10009:1875415569312000:0@lo:502: 00000100:00100000:2.0:1788535808.968883:0:10009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.968914:0:10009:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17900 going to sleep for 11 seconds 00000100:00100000:2.0:1788535808.968930:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569312000 00000100:00100000:2.0:1788535808.968936:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569312000 00000100:00100000:2.0:1788535808.968973:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788535808.968981:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:10009:x1875415569312000:12345-0@lo:502: 00000100:00100000:2.0:1788535808.969062:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:10009:x1875415569312000:12345-0@lo:502: Request processed in 81us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.969069:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788535808.969107:0:10009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10009:1875415569312000:0@lo:502: 00000020:01000000:2.0:1788535808.969126:0:10009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535808.969130:0:10009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535808.969132:0:10009:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788535808.969135:0:10009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788535808.969457:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788535808.969480:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788535808.969488:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.969498:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535808.969507:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788535808.969509:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005831a8000 from 39 10000000:01000000:1.0:1788535808.969512:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788535808.969535:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.969542:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.969550:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535808.969563:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312128:0@lo:101: 00000100:00100000:1.0:1788535808.969600:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.969638:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788535808.969679:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569312128 00000100:00100000:2.0:1788535808.969683:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569312128 00000100:00100000:2.0:1788535808.969736:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788535808.969744:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569312128:12345-0@lo:101: 00010000:00010000:2.0:1788535808.969833:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535808.969844:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc385 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.969864:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc385 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.969874:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc385 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.969882:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460800, rc 0) 00000100:00100000:2.0:1788535808.969950:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569312128:12345-0@lo:101: Request processed in 206us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.969957:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788535808.970076:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312128:0@lo:101: 00010000:00010000:1.0:1788535808.970089:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.970098:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535808.970988:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312256:0@lo:501: 00000100:00100000:1.0:1788535808.971032:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.971329:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788535808.971688:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569312256 00000100:00100000:2.0:1788535808.971695:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569312256 00000100:00100000:2.0:1788535808.971852:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788535808.971861:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569312256:12345-0@lo:501: 00000100:00100000:2.0:1788535808.972054:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569312256:12345-0@lo:501: Request processed in 193us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.972061:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788535808.972125:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312256:0@lo:501: 00000100:00100000:1.0:1788535808.972181:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312384:0@lo:503: 00000100:00100000:1.0:1788535808.972231:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.972252:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788535808.972265:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569312384 00000100:00100000:1.0:1788535808.972269:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569312384 00000100:00100000:1.0:1788535808.972304:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788535808.972312:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569312384:12345-0@lo:503: 00000100:00100000:1.0:1788535808.972387:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569312384:12345-0@lo:503: Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535808.972393:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788535808.973275:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312384:0@lo:503: 00000100:00100000:0.0:1788535808.977141:0:10011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10011:1875415569312512:0@lo:502: 00000100:00100000:0.0:1788535808.977227:0:10011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535808.977264:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569312512 00000100:00100000:0.0:1788535808.977269:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569312512 00000100:00100000:0.0:1788535808.977303:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788535808.977310:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+18:10011:x1875415569312512:12345-0@lo:502: 00000100:00100000:0.0:1788535808.977407:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+18:10011:x1875415569312512:12345-0@lo:502: Request processed in 96us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535808.977423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788535808.977467:0:10011:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535808.977484:0:10011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10011:1875415569312512:0@lo:502: 00000100:00100000:0.0:1788535808.978654:0:10011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10011:1875415569312640:0@lo:502: 00000100:00100000:0.0:1788535808.978706:0:10011:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535808.978737:0:10011:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5b46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535808.979201:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569312640 00000100:00100000:2.0:1788535808.979208:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569312640 00000100:00100000:2.0:1788535808.979260:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788535808.979270:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:10011:x1875415569312640:12345-0@lo:502: 00000100:00100000:2.0:1788535808.979388:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:10011:x1875415569312640:12345-0@lo:502: Request processed in 119us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.979395:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788535808.979582:0:10011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10011:1875415569312640:0@lo:502: 00000040:00080000:1.0:1788535808.979606:0:10011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788535808.979711:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788535808.979738:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788535808.979810:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.979825:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535808.979834:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788535808.979837:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9005831a8000 from 6 10000000:01000000:2.0:1788535808.979840:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788535808.979866:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.979873:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.979881:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535808.979895:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312768:0@lo:101: 00000100:00100000:2.0:1788535808.979938:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.979967:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17840 going to sleep for 11 seconds 00000100:00100000:1.0:1788535808.980008:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569312768 00000100:00100000:1.0:1788535808.980021:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569312768 00000100:00100000:1.0:1788535808.980058:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788535808.980065:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569312768:12345-0@lo:101: 00010000:00010000:1.0:1788535808.980074:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535808.980098:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc39a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc393 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.980122:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc39a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc393 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.980132:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc39a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc393 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.980141:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51800, rc 0) 00000100:00100000:1.0:1788535808.980264:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569312768:12345-0@lo:101: Request processed in 199us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535808.980270:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788535808.980308:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312768:0@lo:101: 00010000:00010000:2.0:1788535808.980322:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.980331:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535808.980388:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312896:0@lo:256: 00000100:00100000:2.0:1788535808.980421:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.980454:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17840 going to sleep for 11 seconds 00000100:00100000:0.0:1788535808.980500:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569312896 00000100:00100000:0.0:1788535808.980505:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569312896 00000100:00100000:0.0:1788535808.980549:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788535808.980557:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569312896:12345-0@lo:256: 20000000:01000000:0.0:1788535808.980570:0:6526:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788535808.980588:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788535808.980591:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788535808.980695:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569312896:12345-0@lo:256: Request processed in 139us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535808.980702:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788535808.981068:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569312896:0@lo:256: 10000000:01000000:1.0:1788535808.981210:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788535808.981218:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.981227:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535808.981306:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788535808.981310:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788535808.981313:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788535808.981339:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.981348:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.981356:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535808.981372:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569313024:0@lo:101: 00000100:00100000:2.0:1788535808.981409:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.981448:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535808.981578:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569313024 00000100:00100000:1.0:1788535808.981584:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569313024 00000100:00100000:1.0:1788535808.981630:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788535808.981638:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569313024:12345-0@lo:101: 00010000:00010000:1.0:1788535808.981653:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535808.981664:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc3a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.981682:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3a1 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.981691:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3a1 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535808.981698:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51400, rc 0) 00000100:00100000:1.0:1788535808.981740:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569313024:12345-0@lo:101: Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535808.981746:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788535808.983897:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569313024:0@lo:101: 00010000:00010000:2.0:1788535808.983922:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535808.983934:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535808.984009:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569313152:0@lo:501: 00000100:00100000:2.0:1788535808.984061:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.984108:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a179c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535808.984127:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569313152 00000100:00100000:2.0:1788535808.984133:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569313152 00000100:00100000:2.0:1788535808.984197:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788535808.984208:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569313152:12345-0@lo:501: 00000100:00100000:2.0:1788535808.984345:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569313152:12345-0@lo:501: Request processed in 139us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.984354:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788535808.984588:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569313152:0@lo:501: 00000100:00100000:1.0:1788535808.984630:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569313280:0@lo:503: 00000100:00100000:1.0:1788535808.984673:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.984701:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535808.987031:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569313280 00000100:00100000:0.0:1788535808.987044:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569313280 00000100:00100000:0.0:1788535808.987099:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788535808.987109:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569313280:12345-0@lo:503: 00000100:00100000:0.0:1788535808.987276:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569313280:12345-0@lo:503: Request processed in 168us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535808.987283:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788535808.987594:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569313280:0@lo:503: 00000100:00100000:1.0:1788535808.988413:0:10012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10012:1875415569313408:0@lo:502: 00000100:00100000:1.0:1788535808.988473:0:10012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.988523:0:10012:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535808.988848:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569313408 00000100:00100000:0.0:1788535808.988856:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569313408 00000100:00100000:0.0:1788535808.988900:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788535808.988909:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:10012:x1875415569313408:12345-0@lo:502: 00000100:00100000:0.0:1788535808.989034:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:10012:x1875415569313408:12345-0@lo:502: Request processed in 126us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535808.989042:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788535808.989064:0:10012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10012:1875415569313408:0@lo:502: 00000020:01000000:1.0:1788535808.989107:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788535808.989115:0:10012:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788535808.989121:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535808.989129:0:10012:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788535808.989135:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788535808.989139:0:10012:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1788535808.989192:0:10012:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788535808.989196:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788535808.989210:0:10012:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90059fa93380) 00000020:00000080:1.0:1788535808.989233:0:10012:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788535808.989239:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788535808.989327:0:10012:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788535808.989333:0:10012:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788535808.989341:0:10012:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdc3b6 00010000:00080000:1.0:1788535808.989369:0:10012:0:(ldlm_lib.c:102:import_set_conn()) imp ffff900487bda000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788535808.989625:0:10012:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788535808.989752:0:10012:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788535808.989764:0:10012:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788535808.989951:0:10012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788535808.990086:0:10012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788535808.990344:0:10012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788535808.990492:0:10012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788535808.994138:0:10013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535808.994165:0:10013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788535808.994484:0:10012:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788535808.994494:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788535808.994532:0:10012:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788535808.994557:0:10012:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdc3bd 00000100:00080000:0.0:1788535808.994567:0:10012:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788535808.994573:0:10012:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff900487bda000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788535808.994609:0:10012:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059e70ea00 x1875415569313536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788535808.994654:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569313536:0@lo:8: 00000100:00100000:0.0:1788535808.994717:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535808.994782:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569313536 00000100:00100000:3.0:1788535808.994792:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569313536 00000100:00100000:3.0:1788535808.994837:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788535808.994844:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3659:x1875415569313536:12345-0@lo:8: 00010000:00080000:3.0:1788535808.994870:0:8447:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1788535808.994893:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdc3c4 00002000:00100000:3.0:1788535808.994908:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90059fa98000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788535808.994913:0:8447:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788535808.994916:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788535808.994975:0:8447:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1788535808.995191:0:10012:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00002000:00080000:3.0:1788535808.995263:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:2.0:1788535808.995284:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569313792:0@lo:400: 00000100:00080000:3.0:1788535808.995296:0:8447:0:(import.c:65:import_set_state_nolock()) ffff90059fa9b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788535808.995328:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.995343:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569313664:0@lo:400: 00000100:00100000:3.0:1788535808.995360:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1875415569313536:12345-0@lo:8: Request processed in 512us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.995366:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569314304:0@lo:400: 00000100:00100000:3.0:1788535808.995372:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788535808.995387:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.995409:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569313792 00000100:00100000:2.0:1788535808.995415:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569313792 00000100:00100000:1.0:1788535808.995420:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569314176:0@lo:400: 00000100:00100000:1.0:1788535808.995443:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.995460:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788535808.995464:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569314688:0@lo:400: 00000100:00100000:2.0:1788535808.995472:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569313792:12345-0@lo:400: 00000100:00100000:1.0:1788535808.995501:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.995514:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569313792:12345-0@lo:400: Request processed in 44us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.995520:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788535808.995524:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788535808.995533:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569314048:0@lo:400: 00000100:00100000:2.0:1788535808.995544:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569313664 00000100:00100000:2.0:1788535808.995548:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569313664 00000100:00100000:1.0:1788535808.995561:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.995569:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569314176 00000100:00100000:2.0:1788535808.995572:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569314176 00000100:00100000:2.0:1788535808.995594:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569314688 00000100:00100000:1.0:1788535808.995594:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569314560:0@lo:400: 00000100:00100000:2.0:1788535808.995599:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569314688 00000100:00100000:2.0:1788535808.995625:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788535808.995633:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569313664:12345-0@lo:400: 00000100:00100000:1.0:1788535808.995644:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.995674:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569313920:0@lo:400: 00000100:00100000:1.0:1788535808.995707:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.995726:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569314432:0@lo:400: 00010000:00080000:0.0:1788535808.995745:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e70ea00 x1875415569313536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788535818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535808.995748:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535808.995773:0:6533:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788535808.995780:0:6533:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788535808.995792:0:6534:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788535808.995797:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569313920 00000100:00100000:1.0:1788535808.995800:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569313920 00000100:00100000:0.0:1788535808.995829:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788535808.995837:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788535808.995843:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788535808.995848:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788535808.995851:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900487bda000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788535808.995861:0:3659:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788535808.995866:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569313536:0@lo:8: 00000004:00080000:0.0:1788535808.995888:0:10013:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788535808.995937:0:10013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 267799789648ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788535808.995943:0:10013:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788535808.996229:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569313664:12345-0@lo:400: Request processed in 596us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.996244:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788535808.996260:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535808.996266:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569314176:12345-0@lo:400: 00000100:00100000:2.0:1788535808.996295:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569314176:12345-0@lo:400: Request processed in 30us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.996301:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535808.996312:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788535808.996318:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569314688:12345-0@lo:400: 00000100:00100000:2.0:1788535808.996341:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569314688:12345-0@lo:400: Request processed in 24us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535808.996348:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788535808.996369:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535808.996370:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569314048 00000100:00100000:3.0:1788535808.996376:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569314048 00000100:00100000:3.0:1788535808.996409:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788535808.996417:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569314048:12345-0@lo:400: 00000100:00100000:3.0:1788535808.996458:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569314048:12345-0@lo:400: Request processed in 43us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535808.996464:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788535808.996516:0:10015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487465500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10015:1875415569314944:0@lo:700: 00000100:00100000:3.0:1788535808.996545:0:10015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535808.996569:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569314944 00000100:00100000:3.0:1788535808.996572:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569314944 00000100:00100000:3.0:1788535808.996606:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788535808.996625:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10015:x1875415569314944:12345-0@lo:700: 00000100:00100000:3.0:1788535808.996653:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487465c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8455:1875415569315072:0@lo:700: 00000100:00080000:2.0:1788535808.996675:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535808.996682:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535808.996692:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535808.996698:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487990180 going to sleep for 11 seconds 00000100:00100000:3.0:1788535808.996711:0:10015:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487990b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535808.996726:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569314816:0@lo:400: 00000100:00100000:1.0:1788535808.996804:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569314304 00000100:00100000:0.0:1788535808.996852:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569314048:0@lo:400: 00010000:00080000:0.0:1788535808.996865:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad3100 x1875415569313664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535808.996874:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569313664:0@lo:400: 00010000:00080000:0.0:1788535808.996888:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad1f80 x1875415569314176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535808.996896:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569314176:0@lo:400: 00010000:00080000:0.0:1788535808.996904:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad0000 x1875415569314688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535808.996911:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569314688:0@lo:400: 00000100:00100000:0.0:1788535808.996941:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569315072 00000100:00100000:0.0:1788535808.996944:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569315072 00000100:00100000:1.0:1788535808.996981:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569314304 00000100:00100000:1.0:1788535808.997023:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788535808.997033:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569313920:12345-0@lo:400: 00000100:00100000:0.0:1788535808.997033:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788535808.997048:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8455:x1875415569315072:12345-0@lo:700: 00000100:00080000:3.0:1788535808.997090:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535808.997235:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569314560 00000100:00100000:0.0:1788535808.997245:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569314560 00000100:00100000:0.0:1788535808.997273:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569314432 00000100:00100000:0.0:1788535808.997277:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569314432 00000100:00100000:0.0:1788535808.997292:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788535808.997298:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569314560:12345-0@lo:400: 00000100:00080000:3.0:1788535808.997481:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535808.997504:0:8447:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788535808.997515:0:8447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788535808.998199:0:6535:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788535808.998214:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788535808.998224:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569314304:12345-0@lo:400: 00000100:00100000:1.0:1788535809.000754:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569313920:12345-0@lo:400: Request processed in 3717us (5038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.000821:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569314560:12345-0@lo:400: Request processed in 3450us (5104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535809.001582:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788535809.001584:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788535809.001672:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad2300 x1875415569313920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535809.001689:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569313920:0@lo:400: 00000100:00100000:0.0:1788535809.001722:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788535809.001737:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569314432:12345-0@lo:400: 00000100:00100000:0.0:1788535809.001987:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569314432:12345-0@lo:400: Request processed in 256us (6239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.001995:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788535809.002032:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad0e00 x1875415569314560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535809.002044:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569314560:0@lo:400: 00000020:01000000:0.0:1788535809.002164:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535809.002171:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535809.002173:0:10012:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788535809.002176:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535809.002181:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535809.002182:0:10012:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788535809.002185:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788535809.002187:0:10012:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788535809.002221:0:10012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10012:1875415569315200:0@lo:502: 00000100:00100000:0.0:1788535809.002270:0:10012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.002297:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569315200 00000100:00100000:0.0:1788535809.002302:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569315200 00000100:00100000:0.0:1788535809.002334:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788535809.002341:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:10012:x1875415569315200:12345-0@lo:502: 00000100:00100000:0.0:1788535809.002462:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:10012:x1875415569315200:12345-0@lo:502: Request processed in 121us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.002467:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788535809.002979:0:10012:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d456000 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.002998:0:10012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10012:1875415569315200:0@lo:502: 00000020:01000000:0.0:1788535809.003023:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535809.003034:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535809.003036:0:10012:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788535809.003040:0:10012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1788535809.003102:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788535809.003123:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788535809.003133:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.003144:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535809.003257:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535809.003301:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569313792:0@lo:400: 00000100:00100000:2.0:1788535809.003338:0:6534:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788535809.003346:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569314816 00000100:00100000:2.0:1788535809.003351:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569314816 00000100:00100000:2.0:1788535809.003384:0:6534:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788535809.003391:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788535809.003399:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569314816:12345-0@lo:400: 00000100:00100000:2.0:1788535809.003451:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569314816:12345-0@lo:400: Request processed in 53us (2578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535809.003458:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788535809.003488:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788535809.003654:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad3800 x1875415569314432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535809.003667:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569314432:0@lo:400: 10000000:01000000:0.0:1788535809.004410:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788535809.004413:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005831fb800 from 39 10000000:01000000:0.0:1788535809.004416:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788535809.004450:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.004459:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.004470:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535809.004490:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569315328:0@lo:101: 00000100:00100000:0.0:1788535809.004536:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.004567:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d456000 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.004584:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569315328 00000100:00100000:0.0:1788535809.004590:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569315328 00000100:00100000:0.0:1788535809.004638:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788535809.004647:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569315328:12345-0@lo:101: 00010000:00010000:0.0:1788535809.004656:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535809.004674:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc3cb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.004696:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3cb expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.004707:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3cb expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.004715:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454800, rc 0) 00000100:00100000:0.0:1788535809.004881:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569315328:12345-0@lo:101: Request processed in 234us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.004887:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788535809.004928:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569315328:0@lo:101: 00010000:00010000:0.0:1788535809.004955:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.005320:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535809.005379:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569315456:0@lo:501: 00000100:00100000:0.0:1788535809.005408:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.005438:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d456000 going to sleep for 11 seconds 00010000:00080000:2.0:1788535809.005723:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad0a80 x1875415569314816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535809.005899:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569314816:0@lo:400: 00000100:00100000:3.0:1788535809.007356:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569314304:12345-0@lo:400: Request processed in 9125us (10655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.007371:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788535809.007488:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad0380 x1875415569314304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535809.007578:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569314304:0@lo:400: 00000100:00100000:1.0:1788535809.008255:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569315456 00000100:00100000:1.0:1788535809.008264:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569315456 00000100:00100000:1.0:1788535809.008309:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788535809.008318:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569315456:12345-0@lo:501: 00000100:00100000:1.0:1788535809.008466:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569315456:12345-0@lo:501: Request processed in 149us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535809.008474:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788535809.008825:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569315456:0@lo:501: 00000100:00100000:1.0:1788535809.008886:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569315584:0@lo:503: 00000100:00100000:1.0:1788535809.008931:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535809.008963:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535809.008976:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569315584 00000100:00100000:1.0:1788535809.008980:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569315584 00000100:00100000:1.0:1788535809.009046:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788535809.009053:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569315584:12345-0@lo:503: 00000100:00100000:1.0:1788535809.009133:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569315584:12345-0@lo:503: Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535809.009625:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788535809.010230:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569315584:0@lo:503: 40000000:02000000:1.0:1788535809.010379:0:6540:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1788535809.011341:0:10018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10018:1875415569315712:0@lo:502: 00000100:00100000:3.0:1788535809.011400:0:10018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535809.011433:0:10018:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487990240 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.012627:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569315712 00000100:00100000:0.0:1788535809.012638:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569315712 00000100:00100000:0.0:1788535809.012734:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788535809.012824:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:10018:x1875415569315712:12345-0@lo:502: 00000100:00100000:0.0:1788535809.013107:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:10018:x1875415569315712:12345-0@lo:502: Request processed in 364us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.013115:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788535809.013289:0:10018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10018:1875415569315712:0@lo:502: 00000100:00100000:3.0:1788535809.013348:0:10018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10018:1875415569315840:0@lo:502: 00000100:00100000:3.0:1788535809.013386:0:10018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535809.013423:0:10018:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487990240 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.013836:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569315840 00000100:00100000:0.0:1788535809.013842:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569315840 00000100:00100000:0.0:1788535809.013877:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788535809.013886:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:10018:x1875415569315840:12345-0@lo:502: 00000100:00100000:0.0:1788535809.014034:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:10018:x1875415569315840:12345-0@lo:502: Request processed in 78us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.014042:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788535809.014117:0:10018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10018:1875415569315840:0@lo:502: 00000040:00080000:3.0:1788535809.014138:0:10018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788535809.014856:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788535809.014879:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788535809.014888:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.014899:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535809.014908:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788535809.014911:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9005831fb800 from 6 10000000:01000000:0.0:1788535809.014914:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788535809.014940:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.014948:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.014957:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535809.015040:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569315968:0@lo:101: 00000100:00100000:0.0:1788535809.015078:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.015105:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.015121:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569315968 00000100:00100000:0.0:1788535809.015126:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569315968 00000100:00100000:0.0:1788535809.015172:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788535809.015179:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569315968:12345-0@lo:101: 00010000:00010000:0.0:1788535809.015188:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535809.015199:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc3e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc3d9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.015221:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3d9 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.015231:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3d9 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.015239:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455800, rc 0) 00000100:00100000:0.0:1788535809.015270:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569315968:12345-0@lo:101: Request processed in 92us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.015277:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788535809.015309:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569315968:0@lo:101: 00010000:00010000:0.0:1788535809.015320:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.015328:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535809.015376:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569316096:0@lo:256: 00000100:00100000:0.0:1788535809.015404:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.015425:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.015437:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569316096 00000100:00100000:0.0:1788535809.015440:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569316096 00000100:00100000:0.0:1788535809.015461:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788535809.015467:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569316096:12345-0@lo:256: 20000000:01000000:0.0:1788535809.015479:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788535809.015493:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788535809.015496:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788535809.015594:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569316096:12345-0@lo:256: Request processed in 126us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.015600:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788535809.015643:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569316096:0@lo:256: 10000000:01000000:0.0:1788535809.015681:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788535809.015687:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.015695:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535809.015702:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788535809.015704:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788535809.015706:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788535809.015719:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.015734:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.015742:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535809.016407:0:7464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788535809.017345:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569316224:0@lo:101: 00000100:00100000:0.0:1788535809.017437:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.017492:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005bab19e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.017512:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569316224 00000100:00100000:0.0:1788535809.017517:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569316224 00000100:00100000:0.0:1788535809.022109:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788535809.022127:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569316224:12345-0@lo:101: 00010000:00010000:0.0:1788535809.022158:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535809.022176:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc3e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.022203:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3e7 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.022213:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3e7 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.022224:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454600, rc 0) 00000100:00100000:0.0:1788535809.022296:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569316224:12345-0@lo:101: Request processed in 176us (4858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.022303:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788535809.022330:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569316224:0@lo:101: 00010000:00010000:2.0:1788535809.022348:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535809.022358:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535809.022430:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569316352:0@lo:501: 00000100:00100000:2.0:1788535809.022464:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535809.022497:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17000 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.024889:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569316352 00000100:00100000:0.0:1788535809.024948:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569316352 00000100:00100000:0.0:1788535809.025076:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788535809.025313:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8455:x1875415569315072:12345-0@lo:700: Request processed in 28267us (28629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535809.025323:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788535809.025367:0:8455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487465c00 x1875415569315072/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788535824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535809.025380:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487465c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8455:1875415569315072:0@lo:700: 40000000:02000000:1.0:1788535809.025392:0:8455:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1788535809.027682:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569316352:12345-0@lo:501: 00000100:00100000:0.0:1788535809.027899:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569316352:12345-0@lo:501: Request processed in 225us (5433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.030740:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788535809.031889:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569316352:0@lo:501: 00000100:00100000:2.0:1788535809.032020:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569316480:0@lo:503: 00000100:00100000:2.0:1788535809.032267:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535809.032302:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17000 going to sleep for 11 seconds 00000100:00100000:2.0:1788535809.032327:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569316480 00000100:00100000:2.0:1788535809.032333:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569316480 00000100:00100000:2.0:1788535809.032373:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788535809.032382:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569316480:12345-0@lo:503: 00000100:00100000:2.0:1788535809.032492:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569316480:12345-0@lo:503: Request processed in 110us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.032499:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569316480:0@lo:503: 00000100:00100000:2.0:1788535809.032499:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788535809.036796:0:10020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10020:1875415569316608:0@lo:502: 00000100:00100000:2.0:1788535809.036878:0:10020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535809.036925:0:10020:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535809.037299:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569316608 00000100:00100000:3.0:1788535809.037307:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569316608 00000100:00100000:3.0:1788535809.037356:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788535809.037365:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:10020:x1875415569316608:12345-0@lo:502: 00000100:00100000:3.0:1788535809.037500:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:10020:x1875415569316608:12345-0@lo:502: Request processed in 135us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.037507:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788535809.037552:0:10020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10020:1875415569316608:0@lo:502: 00000020:01000000:2.0:1788535809.037580:0:10020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788535809.037587:0:10020:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788535809.037594:0:10020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535809.037596:0:10020:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788535809.037602:0:10020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788535809.037606:0:10020:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1788535809.037640:0:10020:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788535809.037644:0:10020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788535809.037659:0:10020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9005b7a7b380) 00000020:00000080:2.0:1788535809.037683:0:10020:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788535809.037689:0:10020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788535809.037798:0:10020:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788535809.037804:0:10020:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788535809.037810:0:10020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdc3fc 00010000:00080000:2.0:1788535809.037838:0:10020:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9004878e8000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788535809.038328:0:10020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788535809.038467:0:10020:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788535809.038479:0:10020:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788535809.038652:0:10020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788535809.039124:0:10020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788535809.039356:0:10020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788535809.039455:0:10020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000001:00100000:1.0:1788535809.044296:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788535809.044408:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10015:x1875415569314944:12345-0@lo:700: Request processed in 47791us (47857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535809.044432:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788535809.044488:0:10015:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487465500 x1875415569314944/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788535824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535809.044503:0:10015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487465500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10015:1875415569314944:0@lo:700: 00000040:00080000:3.0:1788535809.048460:0:10022:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535809.048468:0:10022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788535809.049402:0:10020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788535809.049416:0:10020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788535809.049460:0:10020:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788535809.049486:0:10020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdc403 00000100:00080000:0.0:1788535809.049496:0:10020:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788535809.049503:0:10020:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9004878e8000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788535809.049543:0:10020:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059e70c700 x1875415569316736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788535809.049563:0:10020:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788535809.053085:0:10020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535809.053097:0:10020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535809.053099:0:10020:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788535809.053102:0:10020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788535809.053106:0:10020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535809.053107:0:10020:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788535809.053111:0:10020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788535809.053112:0:10020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788535809.053174:0:10020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10020:1875415569316864:0@lo:502: 00000100:00100000:0.0:1788535809.053253:0:10020:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.053292:0:10020:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.053311:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569316736:0@lo:8: 00000100:00100000:0.0:1788535809.053343:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535809.053470:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569316736 00000100:00100000:1.0:1788535809.053478:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569316736 00000100:00100000:1.0:1788535809.053528:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788535809.053535:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3659:x1875415569316736:12345-0@lo:8: 00010000:00080000:1.0:1788535809.053563:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:1.0:1788535809.053592:0:8446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdc40a 00000100:00100000:2.0:1788535809.055373:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569316864 00000100:00100000:2.0:1788535809.055386:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569316864 00000100:00100000:2.0:1788535809.055431:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788535809.055440:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:10020:x1875415569316864:12345-0@lo:502: 00002000:00100000:1.0:1788535809.056736:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff900487bdd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788535809.056745:0:8446:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788535809.056749:0:8446:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788535809.056839:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788535809.056869:0:8446:0:(import.c:65:import_set_state_nolock()) ffff900487bdb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535809.056955:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1875415569316736:12345-0@lo:8: Request processed in 3417us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535809.056966:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788535809.058652:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e70c700 x1875415569316736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788535819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535809.058668:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788535809.058679:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788535809.058686:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788535809.058692:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788535809.058696:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9004878e8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788535809.058716:0:3659:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788535809.058723:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569316736:0@lo:8: 00000100:00100000:2.0:1788535809.059480:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:10020:x1875415569316864:12345-0@lo:502: Request processed in 4038us (6225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535809.059715:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000004:00080000:2.0:1788535809.061101:0:10015:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788535809.061131:0:10015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10015:1875415569317120:0@lo:7: 00000100:00100000:2.0:1788535809.061229:0:10015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535809.061260:0:10015:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17480 going to sleep for 11 seconds 00000100:00100000:2.0:1788535809.061278:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569316992:0@lo:13: 00000100:00100000:2.0:1788535809.061308:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535809.061347:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569317120 00000100:00100000:2.0:1788535809.061354:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569317120 00000100:00100000:2.0:1788535809.061395:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788535809.061405:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10015:x1875415569317120:12345-0@lo:7: 00000100:00100000:0.0:1788535809.063194:0:10020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10020:1875415569316864:0@lo:502: 00000020:01000000:0.0:1788535809.063239:0:10020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788535809.063248:0:10020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788535809.063251:0:10020:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788535809.063255:0:10020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1788535809.063466:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1788535809.063497:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788535809.063508:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535809.063519:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535809.063528:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788535809.063530:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9005baf299c0 from 1 10000000:01000000:3.0:1788535809.063533:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788535809.063563:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535809.063571:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535809.063579:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535809.063596:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569317248:0@lo:101: 00000100:00100000:3.0:1788535809.063664:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535809.063815:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487990780 going to sleep for 11 seconds 00000004:00080000:1.0:1788535809.064072:0:10022:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788535809.064161:0:10022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 267868013367ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788535809.064170:0:10022:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788535809.064976:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569317248 00000100:00100000:1.0:1788535809.064986:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569317248 00000100:00100000:1.0:1788535809.065111:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788535809.065121:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569317248:12345-0@lo:101: 00010000:00010000:1.0:1788535809.065135:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535809.065170:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc411 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535809.065196:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc411 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535809.065208:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc411 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535809.065217:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51c00, rc 0) 00000100:00100000:1.0:1788535809.065686:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569317248:12345-0@lo:101: Request processed in 566us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535809.065695:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788535809.065815:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569317248:0@lo:101: 00010000:00010000:0.0:1788535809.065832:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.065842:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535809.065906:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569317376:0@lo:501: 00000100:00100000:0.0:1788535809.065939:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.065974:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788535809.066600:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569317376 00000100:00100000:1.0:1788535809.066607:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569317376 00000100:00100000:1.0:1788535809.066654:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788535809.066664:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569317376:12345-0@lo:501: 00000100:00100000:1.0:1788535809.066981:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569317376:12345-0@lo:501: Request processed in 318us (1040us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788535809.068087:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788535809.068224:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569317376:0@lo:501: 10000000:01000000:0.0:1788535809.068267:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788535809.068277:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535809.068288:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535809.070345:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569316992 00000100:00100000:3.0:1788535809.070357:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569316992 00000100:00100000:3.0:1788535809.070408:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788535809.070417:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1875415569316992:12345-0@lo:13: 00002000:00000024:3.0:1788535809.070444:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923832832 avail 3692310528 00000100:00100000:3.0:1788535809.070522:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1875415569316992:12345-0@lo:13: Request processed in 106us (9214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.070529:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788535809.070568:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f1880 x1875415569316992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535809.070589:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569316992:0@lo:13: 00000004:00080000:0.0:1788535809.074960:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788535809.075138:0:10023:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788535809.075196:0:10023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10023:1875415569317632:0@lo:7: 00000100:00100000:0.0:1788535809.075233:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569317504:0@lo:13: 00000100:00100000:1.0:1788535809.075268:0:10023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.075278:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535809.075300:0:10023:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535809.075320:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569317632 00000100:00100000:1.0:1788535809.075328:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569317632 00000100:00080000:2.0:1788535809.075364:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788535809.075392:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788535809.075403:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10023:x1875415569317632:12345-0@lo:7: 00000100:00100000:3.0:1788535809.075518:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569317504 00000100:00100000:3.0:1788535809.075523:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569317504 00002000:00080000:2.0:1788535809.075542:0:8447:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788535809.075548:0:8447:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788535809.075597:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788535809.075604:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10015:x1875415569317120:12345-0@lo:7: Request processed in 14198us (14373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.075608:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569317504:12345-0@lo:13: 00000100:00100000:2.0:1788535809.075631:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788535809.075676:0:10015:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f1f80 x1875415569317120/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788535825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535809.075690:0:10015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10015:1875415569317120:0@lo:7: 00000004:00080000:2.0:1788535809.075702:0:10015:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788535809.075729:0:10015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10015:1875415569317760:0@lo:5: 00002000:00000024:3.0:1788535809.075834:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923832832 avail 3692310528 00000100:00100000:3.0:1788535809.075990:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569317504:12345-0@lo:13: Request processed in 385us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.075997:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788535809.076063:0:10015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535809.076086:0:10015:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17480 going to sleep for 11 seconds 00000100:00100000:2.0:1788535809.076104:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569317760 00000100:00100000:2.0:1788535809.076108:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569317760 00010000:00080000:0.0:1788535809.076124:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487521880 x1875415569317504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535809.076143:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788535809.076216:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569317504:0@lo:13: 00000100:00100000:2.0:1788535809.076221:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10015:x1875415569317760:12345-0@lo:5: 00002000:00080000:2.0:1788535809.076246:0:8447:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788535809.076286:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10015:x1875415569317760:12345-0@lo:5: Request processed in 88us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535809.076294:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788535809.076330:0:10015:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f1f80 x1875415569317760/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535809.076342:0:10015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10015:1875415569317760:0@lo:5: 00000004:00080000:2.0:1788535809.076354:0:10015:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788535809.076384:0:10015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10015:1875415569317888:0@lo:5: 00000100:00100000:2.0:1788535809.076413:0:10015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535809.076428:0:10015:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17480 going to sleep for 11 seconds 00000100:00100000:2.0:1788535809.076445:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569317888 00000100:00100000:2.0:1788535809.076448:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569317888 00000100:00100000:3.0:1788535809.076474:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788535809.076484:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10015:x1875415569317888:12345-0@lo:5: 00002000:00080000:3.0:1788535809.076509:0:10017:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1788535809.080317:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10015:x1875415569317888:12345-0@lo:5: Request processed in 3829us (3898us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788535809.080328:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788535809.080657:0:10015:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f1f80 x1875415569317888/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535809.080675:0:10015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10015:1875415569317888:0@lo:5: 00000004:00080000:2.0:1788535809.080690:0:10015:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788535809.080731:0:10015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10015:1875415569318016:0@lo:900: 00000100:00100000:2.0:1788535809.080905:0:10015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535809.081004:0:10015:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17480 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.081102:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569318016 00000100:00100000:0.0:1788535809.081110:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569318016 00000100:00100000:0.0:1788535809.081189:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788535809.081199:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10015:x1875415569318016:12345-0@lo:900: 00000100:00100000:0.0:1788535809.081261:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10015:x1875415569318016:12345-0@lo:900: Request processed in 63us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535809.081269:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788535809.082904:0:10015:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f0a80 x1875415569318016/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788535825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535809.082922:0:10015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10015:1875415569318016:0@lo:900: 00002000:00080000:2.0:1788535809.084893:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788535809.084901:0:8446:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788535809.084988:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10023:x1875415569317632:12345-0@lo:7: Request processed in 9583us (9716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535809.085009:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788535809.085020:0:10023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487521f80 x1875415569317632/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788535825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535809.085043:0:10023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10023:1875415569317632:0@lo:7: 00000004:00080000:0.0:1788535809.085056:0:10023:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788535809.085095:0:10023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10023:1875415569318144:0@lo:5: 00000100:00100000:0.0:1788535809.085127:0:10023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535809.085170:0:10023:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788535809.087215:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569318144 00000100:00100000:2.0:1788535809.087228:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569318144 00000100:00100000:2.0:1788535809.087283:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788535809.087293:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10023:x1875415569318144:12345-0@lo:5: 00002000:00080000:2.0:1788535809.087323:0:8447:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788535809.087326:0:8447:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1788535809.094677:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:1.0:1788535809.094697:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788535809.094704:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788535809.095938:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10023:x1875415569318144:12345-0@lo:5: Request processed in 8641us (10803us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788535809.095952:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788535809.096299:0:10023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e70df80 x1875415569318144/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535809.096311:0:10023:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788535809.096317:0:10023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10023:1875415569318144:0@lo:5: 00000004:00080000:1.0:1788535809.096331:0:10023:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788535809.096380:0:10023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10023:1875415569318272:0@lo:700: 00000100:00100000:1.0:1788535809.096418:0:10023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535809.096445:0:10023:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.096881:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569318272 00000100:00100000:0.0:1788535809.096888:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569318272 00000100:00100000:0.0:1788535809.096941:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788535809.096952:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10023:x1875415569318272:12345-0@lo:700: 00000100:00100000:3.0:1788535809.108579:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10023:x1875415569318272:12345-0@lo:700: Request processed in 11621us (12152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535809.108594:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788535809.108762:0:10023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487523800 x1875415569318272/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788535825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535809.108778:0:10023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10023:1875415569318272:0@lo:700: 00000004:02000040:1.0:1788535809.111105:0:10023:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1788535809.121962:0:10023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10023:1875415569318400:0@lo:5: 00000100:00100000:1.0:1788535809.122093:0:10023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535809.122178:0:10023:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788535809.122184:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569318400 00000100:00100000:0.0:1788535809.122193:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569318400 00000100:00100000:0.0:1788535809.122245:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788535809.122269:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10023:x1875415569318400:12345-0@lo:5: 00002000:00080000:1.0:1788535809.132175:0:10017:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788535809.132195:0:10017:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788535809.136901:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10023:x1875415569318400:12345-0@lo:5: Request processed in 14627us (14801us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788535809.136912:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788535809.137080:0:10023:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487523800 x1875415569318400/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788535825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535809.137100:0:10023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10023:1875415569318400:0@lo:5: 00000004:00080000:1.0:1788535809.137114:0:10023:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788535809.196916:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788535809.453433:0:10050:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788535809.453665:0:10050:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788535810.222983:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788535810.437407:0:10099:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788535810.437418:0:10099:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788535810.476300:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569318528:0@lo:13: 00000100:00100000:2.0:1788535810.476302:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569318656:0@lo:13: 00000100:00100000:2.0:1788535810.476389:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535810.476427:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535810.476478:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569318656 00000100:00100000:2.0:1788535810.476485:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569318656 00000100:00100000:3.0:1788535810.476495:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569318528 00000100:00100000:3.0:1788535810.476501:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569318528 00000100:00100000:2.0:1788535810.477063:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788535810.481199:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535810.481464:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569318656:12345-0@lo:13: 00002000:00000024:2.0:1788535810.481502:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535810.481745:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569318656:12345-0@lo:13: Request processed in 4672us (5354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535810.481754:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788535810.481778:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788535810.481788:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569318528:12345-0@lo:13: 00002000:00000024:2.0:1788535810.481799:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535810.481843:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569318528:12345-0@lo:13: Request processed in 57us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535810.481849:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788535810.481954:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487467480 x1875415569318528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535810.481975:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569318528:0@lo:13: 00010000:00080000:3.0:1788535810.482590:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f2680 x1875415569318656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535810.482620:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569318656:0@lo:13: 00000100:00100000:0.0:1788535810.990506:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535810.990533:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569318784:0@lo:41: 00000100:00100000:0.0:1788535810.990610:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535810.991323:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569318784 00000100:00100000:3.0:1788535810.991333:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569318784 00000100:00100000:3.0:1788535810.991394:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788535810.991403:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569318784:12345-0@lo:41: 00000004:00000024:3.0:1788535810.991436:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535810.991497:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569318784:12345-0@lo:41: Request processed in 95us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535810.991504:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788535810.991655:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569318784:0@lo:41: 00010000:00010000:0.0:1788535811.244479:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535811.502130:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569318912:0@lo:41: 00000100:00100000:3.0:1788535811.502236:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535811.502443:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569318912 00000100:00100000:0.0:1788535811.502454:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569318912 00000100:00100000:0.0:1788535811.502507:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788535811.502516:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569318912:12345-0@lo:41: 00000004:00000024:0.0:1788535811.502550:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788535811.502612:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569318912:12345-0@lo:41: Request processed in 96us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535811.502619:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788535811.503129:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569318912:0@lo:41: 00000100:00100000:3.0:1788535811.898569:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535811.898658:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548297600 00000100:00100000:1.0:1788535811.898668:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548297600 00000100:00100000:1.0:1788535811.898721:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:1.0:1788535811.898730:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2398:x1875415548297600:12345-192.168.203.13@tcp:250: 00010000:00080000:1.0:1788535811.898757:0:6528:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 91b20ee6-59cb-4913-858f-bc518949fc4a@192.168.203.13@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1788535811.898787:0:6528:0:(genops.c:1385:class_connect()) connect: client 91b20ee6-59cb-4913-858f-bc518949fc4a, cookie 0xe79af2f39bbdc41f 00000100:00080000:1.0:1788535811.899079:0:6528:0:(import.c:65:import_set_state_nolock()) ffff900487bd9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535811.899183:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+5:2398:x1875415548297600:12345-192.168.203.13@tcp:250: Request processed in 452us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535811.899191:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:3.0:1788535811.915385:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535811.917872:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548297472 00000100:00100000:0.0:1788535811.917890:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548297472 00000100:00100000:0.0:1788535811.917958:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:0.0:1788535811.917978:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+5:6158:x1875415548297472:12345-192.168.203.13@tcp:101: 00010000:00010000:0.0:1788535811.917995:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535811.918013:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b16551f0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535811.918045:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f0 expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535811.918058:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f0 expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535811.918086:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455c00, rc 0) 00000100:00100000:0.0:1788535811.918189:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+6:6158:x1875415548297472:12345-192.168.203.13@tcp:101: Request processed in 221us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535811.918197:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:0.0:1788535811.920317:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535811.920380:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548297728 00000100:00100000:2.0:1788535811.920390:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548297728 00000100:00100000:2.0:1788535811.920443:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:2.0:1788535811.920453:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+6:6158:x1875415548297728:12345-192.168.203.13@tcp:501: 00000100:00100000:2.0:1788535811.921668:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+6:6158:x1875415548297728:12345-192.168.203.13@tcp:501: Request processed in 1210us (1353us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788535811.921681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:3.0:1788535811.925253:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535811.927897:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548297856 00000100:00100000:0.0:1788535811.927911:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548297856 00000100:00100000:0.0:1788535811.927988:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:0.0:1788535811.928000:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+6:6158:x1875415548297856:12345-192.168.203.13@tcp:101: 00010000:00010000:0.0:1788535811.928018:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535811.928036:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b16551f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535811.928065:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f7 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535811.928077:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f7 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535811.928086:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454c00, rc 0) 00000100:00100000:0.0:1788535811.928183:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+7:6158:x1875415548297856:12345-192.168.203.13@tcp:101: Request processed in 185us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535811.928192:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:3.0:1788535811.934803:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535811.936377:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548297984 00000100:00100000:1.0:1788535811.936391:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548297984 00000100:00100000:1.0:1788535811.936457:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:1.0:1788535811.936469:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+7:6158:x1875415548297984:12345-192.168.203.13@tcp:501: 00000100:00100000:1.0:1788535811.936636:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+8:6158:x1875415548297984:12345-192.168.203.13@tcp:501: Request processed in 169us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535811.936645:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:2.0:1788535811.948096:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535811.949056:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548298112 00000100:00100000:0.0:1788535811.949068:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548298112 00000100:00100000:0.0:1788535811.949131:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:0.0:1788535811.949141:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+8:6158:x1875415548298112:12345-192.168.203.13@tcp:503: 00000100:00100000:0.0:1788535811.949393:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+8:6158:x1875415548298112:12345-192.168.203.13@tcp:503: Request processed in 253us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535811.949402:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:3.0:1788535811.962323:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535811.963634:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548298240 00000100:00100000:2.0:1788535811.963646:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548298240 00000100:00100000:0.0:1788535811.963860:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:0.0:1788535811.963872:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+8:6176:x1875415548298240:12345-192.168.203.13@tcp:502: 00000100:00100000:0.0:1788535811.964035:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+8:6176:x1875415548298240:12345-192.168.203.13@tcp:502: Request processed in 164us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535811.964044:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:0.0:1788535812.012809:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535812.014230:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548298368 00000100:00100000:1.0:1788535812.014244:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548298368 00000100:00100000:1.0:1788535812.014307:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:1.0:1788535812.014318:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+8:6176:x1875415548298368:12345-192.168.203.13@tcp:502: 00000100:00100000:1.0:1788535812.014489:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+8:6176:x1875415548298368:12345-192.168.203.13@tcp:502: Request processed in 172us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535812.014497:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:3.0:1788535812.025231:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535812.025413:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548298496 00000100:00100000:2.0:1788535812.025422:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548298496 00000100:00100000:2.0:1788535812.025473:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:2.0:1788535812.025483:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+8:6158:x1875415548298496:12345-192.168.203.13@tcp:101: 00010000:00010000:2.0:1788535812.025499:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535812.025516:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655228 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535812.025552:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655228 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535812.025563:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655228 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535812.025572:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461a00, rc 0) 00000100:00100000:2.0:1788535812.025638:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6158:x1875415548298496:12345-192.168.203.13@tcp:101: Request processed in 156us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535812.025644:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:3.0:1788535812.035300:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535812.035766:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548298624 00000100:00100000:0.0:1788535812.035777:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548298624 00000100:00100000:0.0:1788535812.035834:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:0.0:1788535812.035845:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6158:x1875415548298624:12345-192.168.203.13@tcp:256: 20000000:01000000:0.0:1788535812.035867:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788535812.035888:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788535812.035892:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788535812.035895:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788535812.035898:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788535812.035900:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788535812.040724:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6158:x1875415548298624:12345-192.168.203.13@tcp:256: Request processed in 4858us (5410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535812.040740:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1788535812.047313:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535812.047413:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548298752 00000100:00100000:1.0:1788535812.047485:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548298752 00000100:00100000:1.0:1788535812.047648:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:1.0:1788535812.047659:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6158:x1875415548298752:12345-192.168.203.13@tcp:101: 00010000:00010000:1.0:1788535812.047676:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535812.047693:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b165522f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535812.047721:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165522f expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535812.047869:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165522f expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535812.047882:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51000, rc 0) 00000100:00100000:1.0:1788535812.047939:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6158:x1875415548298752:12345-192.168.203.13@tcp:101: Request processed in 283us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535812.047946:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:3.0:1788535812.050329:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535812.050427:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548298880 00000100:00100000:0.0:1788535812.050436:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548298880 00000100:00100000:0.0:1788535812.050497:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:0.0:1788535812.050506:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6158:x1875415548298880:12345-192.168.203.13@tcp:501: 00000100:00100000:0.0:1788535812.050674:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6158:x1875415548298880:12345-192.168.203.13@tcp:501: Request processed in 168us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535812.050681:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:0.0:1788535812.058083:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535812.058672:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548299008 00000100:00100000:1.0:1788535812.058682:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548299008 00000100:00100000:1.0:1788535812.058739:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:1.0:1788535812.058749:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6158:x1875415548299008:12345-192.168.203.13@tcp:503: 00000100:00100000:1.0:1788535812.059030:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6158:x1875415548299008:12345-192.168.203.13@tcp:503: Request processed in 282us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535812.059038:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:3.0:1788535812.064436:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535812.064524:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548299136 00000100:00100000:1.0:1788535812.064534:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548299136 00000100:00100000:1.0:1788535812.064601:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:1.0:1788535812.064611:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6181:x1875415548299136:12345-192.168.203.13@tcp:502: 00000100:00100000:1.0:1788535812.064866:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6181:x1875415548299136:12345-192.168.203.13@tcp:502: Request processed in 255us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535812.064876:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:3.0:1788535812.076072:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535812.076479:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548299264 00000100:00100000:1.0:1788535812.076499:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548299264 00000100:00100000:1.0:1788535812.076552:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:1.0:1788535812.076561:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6181:x1875415548299264:12345-192.168.203.13@tcp:502: 00000100:00100000:1.0:1788535812.076760:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6181:x1875415548299264:12345-192.168.203.13@tcp:502: Request processed in 199us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535812.076767:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:0.0:1788535812.082386:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535812.082431:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535812.082534:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548299392 00000100:00100000:1.0:1788535812.082545:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548299392 00000100:00100000:2.0:1788535812.082546:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548299648 00000100:00100000:2.0:1788535812.082553:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548299648 00000100:00100000:1.0:1788535812.082609:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788535812.082620:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788535812.082621:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875415548299392:12345-192.168.203.13@tcp:38: 00000100:00100000:2.0:1788535812.082630:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1875415548299648:12345-192.168.203.13@tcp:38: 00010000:00080000:2.0:1788535812.082657:0:6534:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp t0 exp 0000000000000000 cur 270 last 0 00010000:00080000:1.0:1788535812.082658:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1788535812.082724:0:6533:0:(genops.c:1385:class_connect()) connect: client b9ef506c-5095-4495-a34a-e3b5845d008a, cookie 0xe79af2f39bbdc442 00000020:00000080:2.0:1788535812.082733:0:6534:0:(genops.c:1385:class_connect()) connect: client b9ef506c-5095-4495-a34a-e3b5845d008a, cookie 0xe79af2f39bbdc449 00000004:00100000:1.0:1788535812.082754:0:6533:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788535812.083052:0:6533:0:(import.c:65:import_set_state_nolock()) ffff900487bd9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535812.083120:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2398:x1875415548299392:12345-192.168.203.13@tcp:38: Request processed in 501us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535812.083128:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000004:00100000:2.0:1788535812.083255:0:6534:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788535812.083409:0:6534:0:(import.c:65:import_set_state_nolock()) ffff900485d00800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788535812.083460:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2398:x1875415548299648:12345-192.168.203.13@tcp:38: Request processed in 830us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535812.083468:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:0.0:1788535812.268416:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535813.095311:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535813.095356:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535813.095432:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548299776 00000100:00100000:3.0:1788535813.095441:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548299776 00000100:00100000:3.0:1788535813.095512:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548299520 00000100:00100000:3.0:1788535813.095516:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548299520 00000100:00100000:3.0:1788535813.095543:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1788535813.095551:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:0:x1875415548299776:12345-192.168.203.13@tcp:41: 00000004:00000024:3.0:1788535813.095598:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535813.095671:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:0:x1875415548299776:12345-192.168.203.13@tcp:41: Request processed in 120us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535813.095678:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1788535813.095694:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788535813.095701:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:0:x1875415548299520:12345-192.168.203.13@tcp:41: 00000004:00000024:3.0:1788535813.095717:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788535813.095753:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:0:x1875415548299520:12345-192.168.203.13@tcp:41: Request processed in 53us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535813.095759:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788535813.096788:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00080000:2.0:1788535813.096916:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535813.096921:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535813.100019:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548299904 00000100:00100000:0.0:1788535813.100033:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548299904 00000100:00100000:0.0:1788535813.100108:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788535813.100118:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6158:x1875415548299904:12345-192.168.203.13@tcp:41: 00000004:00000024:0.0:1788535813.100166:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788535813.100304:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6158:x1875415548299904:12345-192.168.203.13@tcp:41: Request processed in 186us (3518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535813.100312:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788535813.107079:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535813.107237:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548300032 00000100:00100000:0.0:1788535813.107249:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548300032 00000100:00100000:0.0:1788535813.107314:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1788535813.107324:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6158:x1875415548300032:12345-192.168.203.13@tcp:40: 00000100:00100000:0.0:1788535813.107415:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6158:x1875415548300032:12345-192.168.203.13@tcp:40: Request processed in 92us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535813.107423:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788535813.110261:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535813.110358:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548300416 00000100:00100000:0.0:1788535813.110367:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548300416 00000100:00100000:0.0:1788535813.110432:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1788535813.110443:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6158:x1875415548300416:12345-192.168.203.13@tcp:900: 00000100:00100000:0.0:1788535813.110520:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6158:x1875415548300416:12345-192.168.203.13@tcp:900: Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535813.110537:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788535813.111113:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535813.111200:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548300544 00000100:00100000:1.0:1788535813.111206:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548300544 00000100:00100000:1.0:1788535813.111240:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1788535813.111247:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548300544:12345-192.168.203.13@tcp:400: 00000100:00100000:1.0:1788535813.111299:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548300544:12345-192.168.203.13@tcp:400: Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535813.111306:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:2.0:1788535813.111628:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535813.111657:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535813.111722:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548300160 00000100:00100000:1.0:1788535813.111726:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548300160 00000100:00100000:1.0:1788535813.111749:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548300288 00000100:00100000:1.0:1788535813.111752:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548300288 00000100:00100000:1.0:1788535813.111771:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788535813.111781:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1875415548300160:12345-192.168.203.13@tcp:8: 00010000:00080000:1.0:1788535813.111804:0:8448:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:1.0:1788535813.111841:0:8448:0:(genops.c:1385:class_connect()) connect: client b9ef506c-5095-4495-a34a-e3b5845d008a, cookie 0xe79af2f39bbdc450 00000100:00100000:2.0:1788535813.111932:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1788535813.111938:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1875415548300288:12345-192.168.203.13@tcp:8: 00010000:00080000:2.0:1788535813.111955:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1788535813.111973:0:8446:0:(genops.c:1385:class_connect()) connect: client b9ef506c-5095-4495-a34a-e3b5845d008a, cookie 0xe79af2f39bbdc457 00002000:00100000:1.0:1788535813.112073:0:8448:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b9ef506c-5095-4495-a34a-e3b5845d008a/ffff90059e52c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788535813.112090:0:8448:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788535813.112332:0:8448:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788535813.112359:0:8448:0:(import.c:65:import_set_state_nolock()) ffff90059e52e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535813.112405:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2398:x1875415548300160:12345-192.168.203.13@tcp:8: Request processed in 622us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535813.112411:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1788535813.113219:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00002000:00100000:2.0:1788535813.113627:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b9ef506c-5095-4495-a34a-e3b5845d008a/ffff900485d06800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788535813.113647:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788535813.113786:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788535813.113812:0:8446:0:(import.c:65:import_set_state_nolock()) ffff900485d02000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788535813.116211:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2398:x1875415548300288:12345-192.168.203.13@tcp:8: Request processed in 4257us (4538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535813.116244:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1788535813.116793:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548300672 00000100:00100000:3.0:1788535813.116803:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548300672 00000100:00100000:3.0:1788535813.116865:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788535813.116874:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6158:x1875415548300672:12345-192.168.203.13@tcp:33: 00000004:00080000:2.0:1788535813.154496:0:6536:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37529us 00000004:00200000:3.0:1788535813.194108:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788535813.194239:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6158:x1875415548300672:12345-192.168.203.13@tcp:33: Request processed in 77361us (81018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535813.194251:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00010000:00010000:0.0:1788535813.292919:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535813.413352:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535813.414684:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548300800 00000100:00100000:3.0:1788535813.414703:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548300800 00000100:00100000:3.0:1788535813.414769:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788535813.414780:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6199:x1875415548300800:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1788535813.414799:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535813.414873:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030600/0xe79af2f39bbdc45e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655260 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535813.414939:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc465 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535813.414953:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535813.415217:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535813.415261:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788535813.415265:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788535813.415282:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535813.415306:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030600/0xe79af2f39bbdc45e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655260 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535813.415342:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655260 expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535813.415351:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900487807a00) 00010000:00010000:3.0:1788535813.415354:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535813.415357:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030e00, rc 0) 00000100:00100000:3.0:1788535813.415424:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:6199:x1875415548300800:12345-192.168.203.13@tcp:101: Request processed in 646us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535813.415432:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788535814.060973:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569319168:0@lo:400: 00000100:00100000:2.0:1788535814.060973:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569319040:0@lo:400: 00000100:00100000:1.0:1788535814.061051:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569319296:0@lo:400: 00000100:00100000:0.0:1788535814.061072:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569319424:0@lo:400: 00000100:00100000:3.0:1788535814.063575:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535814.063655:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569319680:0@lo:400: 00000100:00100000:3.0:1788535814.063707:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535814.065041:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569320192:0@lo:400: 00000100:00100000:3.0:1788535814.065088:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535814.065138:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569319168 00000100:00100000:3.0:1788535814.065162:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569319168 00000100:00100000:3.0:1788535814.065203:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569319680 00000100:00100000:3.0:1788535814.065206:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569319680 00000100:00100000:3.0:1788535814.065224:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569320192 00000100:00100000:3.0:1788535814.065226:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569320192 00000100:00100000:3.0:1788535814.065239:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788535814.065245:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569319168:12345-0@lo:400: 00000100:00100000:3.0:1788535814.065292:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569319168:12345-0@lo:400: Request processed in 47us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535814.065299:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788535814.065326:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788535814.065331:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569319680:12345-0@lo:400: 00000100:00100000:3.0:1788535814.065354:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569319680:12345-0@lo:400: Request processed in 24us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535814.065359:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788535814.065367:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788535814.065372:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569320192:12345-0@lo:400: 00000100:00100000:3.0:1788535814.065388:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569320192:12345-0@lo:400: Request processed in 17us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535814.065393:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788535814.065406:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535814.066380:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535814.066442:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569319040 00000100:00100000:2.0:1788535814.066448:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569319040 00000100:00100000:2.0:1788535814.066489:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788535814.066498:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569319040:12345-0@lo:400: 00000100:00100000:3.0:1788535814.067087:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569319168:0@lo:400: 00000100:00100000:3.0:1788535814.067113:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569319680:0@lo:400: 00000100:00100000:3.0:1788535814.067124:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569320192:0@lo:400: 00000100:00100000:3.0:1788535814.067205:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569319552:0@lo:400: 00000100:00100000:3.0:1788535814.067244:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535814.067275:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569320064:0@lo:400: 00000100:00100000:3.0:1788535814.067298:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535814.067318:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569320576:0@lo:400: 00000100:00100000:3.0:1788535814.067345:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535814.067357:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569319040:12345-0@lo:400: Request processed in 858us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535814.067368:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788535814.067373:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569320064 00000100:00100000:3.0:1788535814.067378:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569320064 00000100:00100000:3.0:1788535814.067423:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569320576 00000100:00100000:3.0:1788535814.067426:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569320576 00000100:00100000:2.0:1788535814.067431:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569319040:0@lo:400: 00000100:00100000:3.0:1788535814.067457:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788535814.067466:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569320064:12345-0@lo:400: 00000100:00100000:2.0:1788535814.067474:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788535814.067486:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569320576:12345-0@lo:400: 00000100:00100000:3.0:1788535814.067544:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569320064:12345-0@lo:400: Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535814.067551:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788535814.067589:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535814.067593:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788535814.067618:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e018e00 x1875415569320064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535814.067630:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569320064:0@lo:400: 00010000:00080000:3.0:1788535814.067638:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14d180 x1875415569320576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535814.067647:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569320576:0@lo:400: 00000100:00100000:3.0:1788535814.067677:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569319552 00000100:00100000:3.0:1788535814.067681:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569319552 00000100:00100000:2.0:1788535814.067926:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569320576:12345-0@lo:400: Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535814.067934:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788535814.068292:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535814.068317:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569319808:0@lo:400: 00000100:00100000:1.0:1788535814.068345:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535814.068346:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569319296 00000100:00100000:2.0:1788535814.068353:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569319296 00000100:00100000:1.0:1788535814.068366:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569320320:0@lo:400: 00000100:00100000:2.0:1788535814.068382:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788535814.068392:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535814.068395:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569319296:12345-0@lo:400: 00000100:00100000:1.0:1788535814.068425:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569319808 00000100:00100000:1.0:1788535814.068430:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569319808 00000100:00100000:2.0:1788535814.068451:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569319296:12345-0@lo:400: Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535814.068458:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788535814.068463:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569320320 00000100:00100000:1.0:1788535814.068467:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569320320 00000100:00080000:2.0:1788535814.068495:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535814.068590:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535814.068658:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788535814.068666:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569319552:12345-0@lo:400: 00000100:00100000:3.0:1788535814.069010:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569319552:12345-0@lo:400: Request processed in 279us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535814.069019:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788535814.069056:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569319552:0@lo:400: 00000100:00100000:1.0:1788535814.071799:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569319424 00000100:00100000:1.0:1788535814.071826:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569319424 00000100:00100000:3.0:1788535814.071859:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788535814.071872:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569319808:12345-0@lo:400: 00000100:00100000:1.0:1788535814.071875:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788535814.071882:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569320320:12345-0@lo:400: 00000100:00100000:2.0:1788535814.071970:0:6534:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788535814.071984:0:6534:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788535814.072160:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788535814.072171:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569319424:12345-0@lo:400: 00000100:00100000:3.0:1788535814.072479:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569319808:12345-0@lo:400: Request processed in 610us (4131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535814.072481:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569319424:12345-0@lo:400: Request processed in 312us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535814.072492:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788535814.072508:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569319424:0@lo:400: 00000100:00100000:0.0:1788535814.072523:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569319936:0@lo:400: 00000100:00100000:3.0:1788535814.072560:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788535814.072560:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535814.072596:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569319936 00000100:00100000:0.0:1788535814.072601:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569319936 00000100:00100000:0.0:1788535814.072642:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788535814.072649:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569319936:12345-0@lo:400: 00000100:00080000:2.0:1788535814.072681:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535814.072687:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569319936:12345-0@lo:400: Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535814.072777:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569320320:12345-0@lo:400: Request processed in 895us (4386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535814.072794:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788535814.072968:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788535814.072998:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e018000 x1875415569319936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535814.073008:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569319936:0@lo:400: 00000100:00100000:0.0:1788535814.073016:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569320448:0@lo:400: 00000100:00100000:0.0:1788535814.073041:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535814.073362:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569320448 00000100:00100000:2.0:1788535814.073369:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569320448 00000100:00100000:2.0:1788535814.073406:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788535814.073412:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569320448:12345-0@lo:400: 00000100:00100000:2.0:1788535814.073450:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569320448:12345-0@lo:400: Request processed in 38us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535814.073457:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788535814.073475:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788535814.073808:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569319296:0@lo:400: 00010000:00080000:1.0:1788535814.073829:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e01ad80 x1875415569319808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535814.073840:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569319808:0@lo:400: 00010000:00080000:1.0:1788535814.073851:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14fb80 x1875415569320320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535814.073860:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569320320:0@lo:400: 00010000:00080000:0.0:1788535814.079018:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14c700 x1875415569320448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535814.079034:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788535814.079054:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569320448:0@lo:400: 00010000:00010000:0.0:1788535814.316848:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535814.572525:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535814.572549:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569320704:0@lo:13: 00000100:00100000:2.0:1788535814.572634:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535814.572774:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569320704 00000100:00100000:0.0:1788535814.572782:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569320704 00000100:00100000:0.0:1788535814.572895:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788535814.572906:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875415569320704:12345-0@lo:13: 00002000:00000024:0.0:1788535814.572933:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535814.572974:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875415569320704:12345-0@lo:13: Request processed in 70us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535814.572981:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788535814.573091:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487521500 x1875415569320704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535814.573110:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569320704:0@lo:13: 00000100:00100000:3.0:1788535814.573373:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535814.573397:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569320832:0@lo:13: 00000100:00100000:3.0:1788535814.573429:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535814.573504:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569320832 00000100:00100000:0.0:1788535814.573508:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569320832 00000100:00100000:0.0:1788535814.573540:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788535814.573546:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569320832:12345-0@lo:13: 00002000:00000024:0.0:1788535814.573557:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535814.573603:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569320832:12345-0@lo:13: Request processed in 56us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535814.573609:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788535814.573764:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f1f80 x1875415569320832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535814.573779:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569320832:0@lo:13: 00000001:00100000:0.0:1788535815.087567:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000001:00080000:0.0:1788535815.087596:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1788535815.340640:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535815.596393:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535815.596417:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569320960:0@lo:13: 00000100:00100000:3.0:1788535815.596484:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535815.596557:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569320960 00000100:00100000:1.0:1788535815.596575:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569320960 00000100:00100000:1.0:1788535815.596634:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788535815.596643:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569320960:12345-0@lo:13: 00002000:00000024:1.0:1788535815.596671:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535815.596718:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569320960:12345-0@lo:13: Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535815.596725:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788535815.596763:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14f800 x1875415569320960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535815.596781:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569320960:0@lo:13: 00000100:00100000:1.0:1788535815.602202:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569321088:0@lo:13: 00000100:00100000:1.0:1788535815.602272:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535815.602380:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569321088 00000100:00100000:0.0:1788535815.602389:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569321088 00000100:00100000:0.0:1788535815.602444:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788535815.602454:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569321088:12345-0@lo:13: 00002000:00000024:0.0:1788535815.602475:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535815.608880:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569321088:12345-0@lo:13: Request processed in 6418us (6597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535815.608893:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788535815.609047:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f1c00 x1875415569321088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535815.609071:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569321088:0@lo:13: 00000100:00100000:2.0:1788535815.752739:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535815.752887:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548300928 00000100:00100000:0.0:1788535815.752921:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548300928 00000100:00100000:0.0:1788535815.752994:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:0.0:1788535815.753005:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:6251:x1875415548300928:12345-192.168.203.13@tcp:41: 00000004:00000024:0.0:1788535815.753046:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788535815.753121:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:6251:x1875415548300928:12345-192.168.203.13@tcp:41: Request processed in 118us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535815.753127:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00080000:2.0:1788535815.753324:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535815.763521:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535815.763610:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548301056 00000100:00100000:3.0:1788535815.763620:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548301056 00000100:00100000:3.0:1788535815.763714:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788535815.763725:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6251:x1875415548301056:12345-192.168.203.13@tcp:41: 00000004:00000024:3.0:1788535815.763762:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535815.763829:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6251:x1875415548301056:12345-192.168.203.13@tcp:41: Request processed in 105us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535815.763836:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00080000:2.0:1788535815.763912:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788535815.767579:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535815.768420:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548301184 00000100:00100000:3.0:1788535815.768431:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548301184 00000100:00100000:3.0:1788535815.768502:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1788535815.768512:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6251:x1875415548301184:12345-192.168.203.13@tcp:13: 00002000:00000024:3.0:1788535815.768537:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535815.768607:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9ef506c-5095-4495-a34a-e3b5845d008a+6:6251:x1875415548301184:12345-192.168.203.13@tcp:13: Request processed in 96us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535815.768613:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00080000:2.0:1788535815.768827:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535815.771316:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535815.771406:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548301312 00000100:00100000:3.0:1788535815.771415:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548301312 00000100:00100000:3.0:1788535815.771497:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1788535815.771507:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9ef506c-5095-4495-a34a-e3b5845d008a+5:6251:x1875415548301312:12345-192.168.203.13@tcp:13: 00002000:00000024:3.0:1788535815.771532:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535815.771605:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b9ef506c-5095-4495-a34a-e3b5845d008a+5:6251:x1875415548301312:12345-192.168.203.13@tcp:13: Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535815.771616:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00080000:2.0:1788535815.771692:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535816.110616:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569321216:0@lo:41: 00000100:00100000:3.0:1788535816.110698:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535816.110905:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569321216 00000100:00100000:0.0:1788535816.110914:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569321216 00000100:00100000:0.0:1788535816.110962:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788535816.110971:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569321216:12345-0@lo:41: 00000004:00000024:0.0:1788535816.110995:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535816.111045:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569321216:12345-0@lo:41: Request processed in 74us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535816.111052:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788535816.111229:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569321216:0@lo:41: 00010000:00010000:0.0:1788535816.370169:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535816.621440:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535816.621467:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569321344:0@lo:41: 00000100:00100000:0.0:1788535816.621533:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535816.621606:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569321344 00000100:00100000:0.0:1788535816.621614:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569321344 00000100:00100000:0.0:1788535816.621659:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788535816.621668:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569321344:12345-0@lo:41: 00000004:00000024:0.0:1788535816.621717:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788535816.621760:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569321344:12345-0@lo:41: Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535816.621766:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788535816.621826:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569321344:0@lo:41: 00010000:00010000:0.0:1788535817.388624:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788535818.159682:0:7464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000001:00100000:1.0:1788535818.160178:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00010000:00010000:1.0:1788535818.415106:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788535818.559104:0:10198:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788535818.624328:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535818.624369:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535818.624399:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535818.624424:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535818.624452:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535818.624479:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548301696 00000100:00100000:2.0:1788535818.624487:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548301696 00000100:00100000:2.0:1788535818.624542:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548301568 00000100:00100000:2.0:1788535818.624544:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548301568 00000100:00100000:2.0:1788535818.624581:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1788535818.624591:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548301696:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788535818.624658:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548301696:12345-192.168.203.13@tcp:400: Request processed in 69us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535818.624665:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1788535818.624679:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788535818.624685:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548301568:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788535818.624705:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548301568:12345-192.168.203.13@tcp:400: Request processed in 21us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535818.624711:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788535818.624728:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548301952 00000100:00100000:2.0:1788535818.624731:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548301952 00000100:00100000:2.0:1788535818.624754:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548301824 00000100:00100000:2.0:1788535818.624757:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548301824 00000100:00100000:2.0:1788535818.624774:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1788535818.624779:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548301952:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788535818.624800:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548301952:12345-192.168.203.13@tcp:400: Request processed in 22us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535818.624815:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1788535818.624827:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1788535818.624844:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548301824:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788535818.625006:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548301824:12345-192.168.203.13@tcp:400: Request processed in 171us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535818.625013:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00080000:2.0:1788535818.625037:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535818.625041:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535818.625044:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535818.625045:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535818.625253:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548301440 00000100:00100000:3.0:1788535818.625258:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548301440 00000100:00100000:3.0:1788535818.625297:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:3.0:1788535818.625304:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548301440:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1788535818.625337:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548301440:12345-192.168.203.13@tcp:400: Request processed in 34us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535818.625343:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:0.0:1788535819.182171:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569321728:0@lo:400: 00000100:00100000:0.0:1788535819.182237:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.182292:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569322240:0@lo:400: 00000100:00100000:0.0:1788535819.182315:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.182336:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569322752:0@lo:400: 00000100:00100000:0.0:1788535819.182354:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.182379:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788535819.182385:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569321856:0@lo:400: 00000100:00100000:0.0:1788535819.182405:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.182419:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569322368:0@lo:400: 00000100:00100000:0.0:1788535819.182439:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.182454:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569322880:0@lo:400: 00000100:00100000:0.0:1788535819.182471:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.182502:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569321728 00000100:00100000:0.0:1788535819.182509:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569321728 00000100:00100000:0.0:1788535819.182568:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788535819.182578:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569321728:12345-0@lo:400: 00000100:00100000:0.0:1788535819.182632:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569321728:12345-0@lo:400: Request processed in 57us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.182639:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788535819.182675:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569322240 00000100:00100000:0.0:1788535819.182680:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569322240 00000100:00100000:0.0:1788535819.182717:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569322752 00000100:00100000:0.0:1788535819.182721:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569322752 00000100:00100000:0.0:1788535819.182736:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569321856 00000100:00100000:0.0:1788535819.182739:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569321856 00000100:00100000:0.0:1788535819.182751:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788535819.182757:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569322240:12345-0@lo:400: 00000100:00100000:0.0:1788535819.182788:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569322240:12345-0@lo:400: Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.182794:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788535819.182807:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788535819.182813:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569322752:12345-0@lo:400: 00000100:00100000:0.0:1788535819.182840:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569322752:12345-0@lo:400: Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.182846:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788535819.182858:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788535819.182864:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569321856:12345-0@lo:400: 00000100:00100000:0.0:1788535819.182890:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569321856:12345-0@lo:400: Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.182896:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788535819.182932:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569321856:0@lo:400: 00000100:00100000:0.0:1788535819.182944:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569321728:0@lo:400: 00010000:00080000:0.0:1788535819.182955:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf2a00 x1875415569322240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535819.182965:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569322240:0@lo:400: 00010000:00080000:0.0:1788535819.182975:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3480 x1875415569322752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535819.182995:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569322752:0@lo:400: 00000100:00100000:2.0:1788535819.183102:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569321472:0@lo:400: 00000100:00100000:2.0:1788535819.183138:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535819.183194:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569321984:0@lo:400: 00000100:00100000:2.0:1788535819.183217:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535819.183235:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569322496:0@lo:400: 00000100:00100000:2.0:1788535819.183267:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535819.183287:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569323008:0@lo:400: 00000100:00100000:2.0:1788535819.183308:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535819.183328:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788535819.183334:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569321600:0@lo:400: 00000100:00100000:2.0:1788535819.183355:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535819.183372:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569322112:0@lo:400: 00000100:00100000:2.0:1788535819.183393:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535819.183404:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569322624:0@lo:400: 00000100:00100000:2.0:1788535819.183433:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535819.183455:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569321600 00000100:00100000:2.0:1788535819.183459:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569321600 00000100:00100000:2.0:1788535819.183481:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569322112 00000100:00100000:2.0:1788535819.183483:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569322112 00000100:00100000:2.0:1788535819.183498:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569322624 00000100:00100000:2.0:1788535819.183500:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569322624 00000100:00100000:2.0:1788535819.183514:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788535819.183520:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569321600:12345-0@lo:400: 00000100:00100000:2.0:1788535819.183608:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569321600:12345-0@lo:400: Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.183615:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788535819.183626:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788535819.183633:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569322112:12345-0@lo:400: 00000100:00100000:2.0:1788535819.183658:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569322112:12345-0@lo:400: Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.183664:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788535819.183674:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788535819.183679:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569322624:12345-0@lo:400: 00000100:00100000:2.0:1788535819.183701:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569322624:12345-0@lo:400: Request processed in 22us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.183706:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788535819.183727:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569322368 00000100:00100000:2.0:1788535819.183730:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569322368 00000100:00100000:2.0:1788535819.183747:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569322880 00000100:00100000:2.0:1788535819.183750:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569322880 00000100:00100000:2.0:1788535819.183760:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569322496 00000100:00100000:2.0:1788535819.183762:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569322496 00000100:00100000:2.0:1788535819.183780:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569323008 00000100:00100000:2.0:1788535819.183783:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569323008 00000100:00100000:2.0:1788535819.183794:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788535819.183799:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569322368:12345-0@lo:400: 00000100:00100000:2.0:1788535819.183835:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569322368:12345-0@lo:400: Request processed in 35us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.183840:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788535819.183851:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788535819.183857:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569322880:12345-0@lo:400: 00000100:00100000:2.0:1788535819.183895:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569322880:12345-0@lo:400: Request processed in 37us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.183900:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788535819.183911:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788535819.183916:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569322496:12345-0@lo:400: 00000100:00100000:2.0:1788535819.183941:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569322496:12345-0@lo:400: Request processed in 25us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.183946:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788535819.183956:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788535819.183962:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569323008:12345-0@lo:400: 00000100:00100000:2.0:1788535819.183985:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569323008:12345-0@lo:400: Request processed in 24us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.183990:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788535819.184010:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535819.184013:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535819.184016:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535819.184018:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535819.184040:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569321984 00000100:00100000:2.0:1788535819.184048:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569321984 00000100:00100000:2.0:1788535819.184076:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788535819.184082:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569321984:12345-0@lo:400: 00000100:00100000:2.0:1788535819.184113:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569321984:12345-0@lo:400: Request processed in 32us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.184119:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788535819.184178:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569321600:0@lo:400: 00000100:00100000:2.0:1788535819.184189:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569322112:0@lo:400: 00000100:00100000:2.0:1788535819.184198:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569322624:0@lo:400: 00000100:00100000:2.0:1788535819.184206:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569321984:0@lo:400: 00010000:00080000:2.0:1788535819.184216:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf1500 x1875415569322496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535819.184225:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569322496:0@lo:400: 00010000:00080000:2.0:1788535819.184234:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf0700 x1875415569323008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535819.184241:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788535819.184254:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569323008:0@lo:400: 00010000:00080000:2.0:1788535819.184285:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf2680 x1875415569322368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535819.184294:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569322368:0@lo:400: 00010000:00080000:2.0:1788535819.184304:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3b80 x1875415569322880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535819.184311:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569322880:0@lo:400: 00000100:00100000:0.0:1788535819.186803:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569321472 00000100:00100000:0.0:1788535819.186819:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569321472 00000100:00100000:0.0:1788535819.186880:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788535819.186889:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569321472:12345-0@lo:400: 00000100:00100000:0.0:1788535819.187048:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569321472:12345-0@lo:400: Request processed in 160us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.187055:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000001:00100000:0.0:1788535819.192441:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000100:00100000:1.0:1788535819.192739:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569321472:0@lo:400: 00010000:00010000:0.0:1788535819.445752:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535819.694092:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535819.694098:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535819.694120:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569323136:0@lo:13: 00000100:00100000:0.0:1788535819.694120:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569323264:0@lo:13: 00000100:00100000:0.0:1788535819.696399:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535819.696462:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569323264 00000100:00100000:0.0:1788535819.696470:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569323264 00000100:00100000:0.0:1788535819.696510:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788535819.696518:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569323264:12345-0@lo:13: 00002000:00000024:0.0:1788535819.696558:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535819.696599:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569323264:12345-0@lo:13: Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535819.696615:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788535819.696785:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535819.696817:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569323136 00000100:00100000:2.0:1788535819.696820:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569323136 00000100:00100000:2.0:1788535819.696851:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788535819.696852:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3480 x1875415569323264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535819.696857:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569323136:12345-0@lo:13: 00000100:00100000:0.0:1788535819.696941:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569323264:0@lo:13: 00002000:00000024:2.0:1788535819.697034:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535819.697074:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569323136:12345-0@lo:13: Request processed in 217us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535819.697080:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788535819.697098:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb32a00 x1875415569323136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535819.697112:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569323136:0@lo:13: 00010000:00010000:0.0:1788535820.460327:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535820.718555:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535820.718579:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569323392:0@lo:13: 00000100:00100000:3.0:1788535820.718640:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535820.718705:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569323392 00000100:00100000:3.0:1788535820.718711:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569323392 00000100:00100000:3.0:1788535820.718751:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788535820.718758:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569323392:12345-0@lo:13: 00002000:00000024:3.0:1788535820.718783:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535820.718830:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569323392:12345-0@lo:13: Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535820.718837:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788535820.718874:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14ca80 x1875415569323392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535820.718893:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569323392:0@lo:13: 00000100:00100000:1.0:1788535820.720012:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788535820.720032:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569323520:0@lo:13: 00000100:00100000:1.0:1788535820.720086:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535820.720321:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569323520 00000100:00100000:2.0:1788535820.720328:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569323520 00000100:00100000:2.0:1788535820.720371:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788535820.720379:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569323520:12345-0@lo:13: 00002000:00000024:2.0:1788535820.720396:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535820.720444:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569323520:12345-0@lo:13: Request processed in 65us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535820.720450:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788535820.720516:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb31500 x1875415569323520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535820.720574:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569323520:0@lo:13: 00000100:00100000:0.0:1788535821.230182:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535821.230219:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569323648:0@lo:41: 00000100:00100000:0.0:1788535821.230298:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535821.230458:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569323648 00000100:00100000:2.0:1788535821.230467:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569323648 00000100:00100000:2.0:1788535821.230522:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788535821.230542:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569323648:12345-0@lo:41: 00000004:00000024:2.0:1788535821.230584:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788535821.230642:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569323648:12345-0@lo:41: Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535821.230649:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788535821.230684:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569323648:0@lo:41: 00010000:00010000:0.0:1788535821.484366:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788535821.736950:0:10345:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd234f8b50 20000000:00000080:0.0:1788535821.736968:0:10345:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90059fb3a000 uarg=0000000000000000 20000000:01000000:0.0:1788535821.737009:0:10345:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788535821.737012:0:10345:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788535821.737014:0:10345:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788535821.737019:0:10345:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788535821.737024:0:10345:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788535821.737382:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788535821.737385:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788535821.737881:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788535821.738418:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788535821.738446:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788535821.738463:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1788535821.738474:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788535821.738476:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788535821.738770:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788535821.738918:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788535821.738939:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788535821.738956:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1788535821.738965:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788535821.738967:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788535821.739732:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788535821.739911:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788535821.739934:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788535821.739951:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1788535821.739961:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788535821.739964:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788535821.740555:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788535821.740854:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788535821.740882:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788535821.740934:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1788535821.740947:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788535821.740950:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788535821.741562:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788535821.741718:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788535821.741739:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788535821.741753:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1788535821.741766:0:10345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788535821.741787:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741807:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc300 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741815:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc32a expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741822:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc369 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741829:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc377 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741836:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc385 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741850:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3a1 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741856:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3cb expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741864:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc3e7 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741870:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc411 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741880:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f0 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741887:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f7 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741896:0:10345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741936:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f7 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.741952:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f7 expref: 9 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.741968:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569323776:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535821.742090:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f0 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742106:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f0 expref: 9 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742115:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569323904:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535821.742201:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc411 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742210:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc411 expref: 23 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742220:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324032:0@lo:104: 00000100:00100000:3.0:1788535821.742371:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535821.742409:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc3e7 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742419:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3e7 expref: 23 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742428:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324160:0@lo:104: 00000100:00100000:3.0:1788535821.742448:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535821.742468:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc3cb expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742476:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3cb expref: 23 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742484:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324288:0@lo:104: 00000100:00100000:3.0:1788535821.742502:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535821.742541:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc3a1 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742550:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3a1 expref: 23 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742559:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324416:0@lo:104: 00000100:00100000:3.0:1788535821.742581:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535821.742596:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc385 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742605:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc385 expref: 23 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742613:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324544:0@lo:104: 00010000:00010000:3.0:1788535821.742634:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc377 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742642:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc377 expref: 23 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742650:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324672:0@lo:104: 00010000:00010000:3.0:1788535821.742671:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc369 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742678:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc369 expref: 23 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742686:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324800:0@lo:104: 00010000:00010000:3.0:1788535821.742722:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc32a expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742735:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc32a expref: 23 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742744:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324928:0@lo:104: 00010000:00010000:3.0:1788535821.742777:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc300 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535821.742786:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc300 expref: 23 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.742793:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569325056:0@lo:104: 00000100:00100000:3.0:1788535821.742810:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173840 going to sleep for 11 seconds 00000100:00100000:0.0:1788535821.742895:0:6518:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788535821.742913:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535821.742926:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535821.742934:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535821.742943:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535821.742951:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535821.742959:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569324032 00000100:00100000:0.0:1788535821.742964:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569324032 00000100:00100000:0.0:1788535821.742997:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569324160 00000100:00100000:0.0:1788535821.742999:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569324160 00000100:00100000:0.0:1788535821.743007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569324288 00000100:00100000:0.0:1788535821.743010:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569324288 00000100:00100000:0.0:1788535821.743017:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569324416 00000100:00100000:0.0:1788535821.743018:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569324416 00000100:00100000:0.0:1788535821.743026:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569324544 00000100:00100000:0.0:1788535821.743029:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569324544 00000100:00100000:0.0:1788535821.743035:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569324672 00000100:00100000:0.0:1788535821.743037:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569324672 00000100:00100000:0.0:1788535821.743044:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569324800 00000100:00100000:0.0:1788535821.743047:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569324800 00000100:00100000:0.0:1788535821.743054:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569324928 00000100:00100000:0.0:1788535821.743055:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569324928 00000100:00100000:0.0:1788535821.743062:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569325056 00000100:00100000:0.0:1788535821.743064:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569325056 00000100:00100000:0.0:1788535821.743142:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788535821.743176:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+11:10345:x1875415569324032:12345-0@lo:104: 00010000:00010000:0.0:1788535821.743188:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743316:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788535821.743322:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+11:10345:x1875415569324032:12345-0@lo:104: Request processed in 150us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535821.743329:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788535821.743345:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788535821.743351:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+10:10345:x1875415569324160:12345-0@lo:104: 00010000:00010000:0.0:1788535821.743359:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743389:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788535821.743394:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+10:10345:x1875415569324160:12345-0@lo:104: Request processed in 44us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535821.743400:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788535821.743411:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788535821.743416:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+9:10345:x1875415569324288:12345-0@lo:104: 00010000:00010000:0.0:1788535821.743423:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743451:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788535821.743456:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+9:10345:x1875415569324288:12345-0@lo:104: Request processed in 41us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535821.743462:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788535821.743473:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788535821.743479:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+8:10345:x1875415569324416:12345-0@lo:104: 00010000:00010000:0.0:1788535821.743486:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743516:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788535821.743521:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+8:10345:x1875415569324416:12345-0@lo:104: Request processed in 43us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535821.743538:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788535821.743573:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788535821.743579:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+7:10345:x1875415569324544:12345-0@lo:104: 00010000:00010000:0.0:1788535821.743586:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743611:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788535821.743616:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+7:10345:x1875415569324544:12345-0@lo:104: Request processed in 38us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535821.743621:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788535821.743632:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788535821.743638:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+6:10345:x1875415569324672:12345-0@lo:104: 00010000:00010000:0.0:1788535821.743645:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743670:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788535821.743675:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+6:10345:x1875415569324672:12345-0@lo:104: Request processed in 38us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535821.743680:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788535821.743690:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788535821.743695:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+5:10345:x1875415569324800:12345-0@lo:104: 00010000:00010000:0.0:1788535821.743702:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743734:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788535821.743740:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+5:10345:x1875415569324800:12345-0@lo:104: Request processed in 45us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535821.743746:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788535821.743758:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788535821.743764:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:10345:x1875415569324928:12345-0@lo:104: 00010000:00010000:0.0:1788535821.743771:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743795:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788535821.743799:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:10345:x1875415569324928:12345-0@lo:104: Request processed in 36us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535821.743804:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788535821.743815:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788535821.743820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+3:10345:x1875415569325056:12345-0@lo:104: 00010000:00010000:0.0:1788535821.743826:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743850:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1788535821.743855:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+3:10345:x1875415569325056:12345-0@lo:104: Request processed in 36us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535821.743860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788535821.743879:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788535821.743884:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743901:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580031a00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535821.743905:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743912:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535821.743918:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535821.743923:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535821.743954:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743960:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535821.743977:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743983:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff900580031a00/0xe79af2f39bbdc411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc418 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.743996:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788535821.743999:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.744004:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454200 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535821.744007:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.744024:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535821.744030:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535821.744035:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788535821.744048:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.744054:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535821.744059:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535821.744065:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc3e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc3ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744346:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788535821.744352:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744359:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455400 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535821.744363:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744371:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535821.744378:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535821.744383:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535821.744410:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744416:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535821.744429:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744436:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e455400/0xe79af2f39bbdc3cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc3d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744445:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788535821.744448:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744453:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460a00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535821.744456:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744463:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535821.744469:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535821.744475:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535821.744486:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744491:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535821.744495:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744512:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e460a00/0xe79af2f39bbdc3a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc3a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744520:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788535821.744523:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744538:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51e00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535821.744541:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744548:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535821.744555:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535821.744560:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535821.744574:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744579:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535821.744584:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744590:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbdc385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc38c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744599:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788535821.744608:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744613:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460e00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535821.744615:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744622:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535821.744628:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535821.744632:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535821.744646:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744652:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535821.744656:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744662:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc37e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744671:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788535821.744673:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744679:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455e00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535821.744682:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744699:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535821.744706:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535821.744711:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535821.744726:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744732:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535821.744736:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744742:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e455e00/0xe79af2f39bbdc369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc370 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744750:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788535821.744753:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744757:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50000 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535821.744760:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744766:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535821.744771:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535821.744781:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535821.744807:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744812:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535821.744816:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744822:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058af50000/0xe79af2f39bbdc32a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc331 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744831:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535821.744834:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744839:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460200 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535821.744841:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744847:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535821.744853:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535821.744858:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788535821.744870:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744875:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535821.744885:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744891:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e460200/0xe79af2f39bbdc300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc307 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.744899:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535821.744901:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535821.744903:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535821.744911:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535821.744923:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569325568:0@lo:103: 00000100:00100000:1.0:1788535821.744965:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.744987:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569326080:0@lo:103: 00000100:00100000:1.0:1788535821.745005:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.745024:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788535821.745031:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569325440:0@lo:103: 00000100:00100000:1.0:1788535821.745049:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.745064:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569325952:0@lo:103: 00000100:00100000:1.0:1788535821.745098:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.745121:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569325568 00000100:00100000:1.0:1788535821.745128:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569325568 00010000:00010000:1.0:1788535821.745182:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3a1 expref: 24 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.745199:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569326080 00000100:00100000:1.0:1788535821.745201:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569326080 00010000:00010000:1.0:1788535821.745213:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc32a expref: 25 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.745223:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569325440 00000100:00100000:1.0:1788535821.745233:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569325440 00010000:00010000:1.0:1788535821.745247:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3cb expref: 26 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.745258:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569325952 00000100:00100000:1.0:1788535821.745261:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569325952 00010000:00010000:1.0:1788535821.745270:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc369 expref: 27 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.745282:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788535821.745290:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+27:3661:x1875415569325568:12345-0@lo:103: 00010000:00010000:1.0:1788535821.745300:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.745306:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3a1 expref: 27 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.745317:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3a1 expref: 27 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.745337:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.745369:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+27:3661:x1875415569325568:12345-0@lo:103: Request processed in 79us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.745376:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788535821.745413:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788535821.745419:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+26:3661:x1875415569326080:12345-0@lo:103: 00010000:00010000:1.0:1788535821.745425:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.745429:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc32a expref: 26 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.745438:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc32a expref: 26 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.745469:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.745493:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+26:3661:x1875415569326080:12345-0@lo:103: Request processed in 75us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.745500:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788535821.745514:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535821.745520:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+25:3661:x1875415569325440:12345-0@lo:103: 00010000:00010000:1.0:1788535821.745539:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.745544:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3cb expref: 25 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.745553:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3cb expref: 25 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.745563:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.745584:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+25:3661:x1875415569325440:12345-0@lo:103: Request processed in 64us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.745590:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535821.745600:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788535821.745606:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569325952:12345-0@lo:103: 00010000:00010000:1.0:1788535821.745614:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.745618:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc369 expref: 24 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.745626:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc369 expref: 24 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.745635:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.745665:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569325952:12345-0@lo:103: Request processed in 59us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.745672:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788535821.745712:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569325440:0@lo:103: 00000100:00100000:1.0:1788535821.745722:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569325952:0@lo:103: 00000100:00100000:1.0:1788535821.745730:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569325568:0@lo:103: 00000100:00100000:1.0:1788535821.745738:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569326080:0@lo:103: 00000100:00100000:1.0:1788535821.745787:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569325312:0@lo:103: 00000100:00100000:1.0:1788535821.745812:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.745830:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569325824:0@lo:103: 00000100:00100000:1.0:1788535821.745848:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.745859:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788535821.745864:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569325184:0@lo:103: 00000100:00100000:1.0:1788535821.745881:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.745891:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569325696:0@lo:103: 00000100:00100000:1.0:1788535821.745908:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.745916:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569326208:0@lo:103: 00000100:00100000:1.0:1788535821.745933:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.745953:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569325312 00000100:00100000:1.0:1788535821.745956:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569325312 00010000:00010000:1.0:1788535821.745972:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3e7 expref: 24 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.745985:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569325824 00000100:00100000:1.0:1788535821.745987:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569325824 00010000:00010000:1.0:1788535821.746005:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc377 expref: 25 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.746017:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569325184 00000100:00100000:1.0:1788535821.746020:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569325184 00010000:00010000:1.0:1788535821.746029:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc411 expref: 26 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.746039:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569325696 00000100:00100000:1.0:1788535821.746041:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569325696 00010000:00010000:1.0:1788535821.746050:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc385 expref: 27 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.746060:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569326208 00000100:00100000:1.0:1788535821.746063:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569326208 00010000:00010000:1.0:1788535821.746071:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc300 expref: 28 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.746083:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788535821.746089:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+28:3663:x1875415569325312:12345-0@lo:103: 00010000:00010000:1.0:1788535821.746097:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.746101:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3e7 expref: 28 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746110:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc3e7 expref: 28 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746120:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.746174:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+28:3663:x1875415569325312:12345-0@lo:103: Request processed in 85us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.746181:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788535821.746203:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788535821.746210:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+27:3663:x1875415569325824:12345-0@lo:103: 00010000:00010000:1.0:1788535821.746218:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.746223:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc377 expref: 27 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746232:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc377 expref: 27 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746242:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.746266:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+27:3663:x1875415569325824:12345-0@lo:103: Request processed in 57us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.746272:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788535821.746283:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788535821.746289:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+26:3663:x1875415569325184:12345-0@lo:103: 00010000:00010000:1.0:1788535821.746296:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.746300:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc411 expref: 26 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746308:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc411 expref: 26 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746317:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.746337:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+26:3663:x1875415569325184:12345-0@lo:103: Request processed in 48us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.746343:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788535821.746353:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788535821.746358:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfa8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+25:3663:x1875415569325696:12345-0@lo:103: 00010000:00010000:1.0:1788535821.746366:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.746376:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc385 expref: 25 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746385:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc385 expref: 25 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746394:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.746417:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfa8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+25:3663:x1875415569325696:12345-0@lo:103: Request processed in 59us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.746423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788535821.746451:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788535821.746457:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569326208:12345-0@lo:103: 00010000:00010000:1.0:1788535821.746464:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.746468:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc300 expref: 24 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746476:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc300 expref: 24 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.746485:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.746505:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569326208:12345-0@lo:103: Request processed in 48us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.746510:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788535821.746547:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569325184:0@lo:103: 00000100:00100000:1.0:1788535821.746554:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569325696:0@lo:103: 00000100:00100000:1.0:1788535821.746559:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569326208:0@lo:103: 00000100:00100000:1.0:1788535821.746565:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569325312:0@lo:103: 00000100:00100000:1.0:1788535821.746582:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569325824:0@lo:103: 00010000:00010000:0.0:1788535821.746913:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535821.746917:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535821.746920:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535821.747170:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51c00/0xe79af2f39bbdc418 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc411 expref: 23 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.747185:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324032:0@lo:104: 00010000:00010000:3.0:1788535821.747198:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e454600/0xe79af2f39bbdc3ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc3e7 expref: 22 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.747207:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324160:0@lo:104: 00010000:00010000:3.0:1788535821.747218:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc3d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc3cb expref: 21 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.747338:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324288:0@lo:104: 00010000:00010000:3.0:1788535821.747354:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc3a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc3a1 expref: 20 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.747364:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324416:0@lo:104: 00010000:00010000:3.0:1788535821.747384:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e460800/0xe79af2f39bbdc38c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc385 expref: 19 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.747392:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324544:0@lo:104: 00010000:00010000:3.0:1788535821.747400:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50a00/0xe79af2f39bbdc37e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc377 expref: 18 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.747407:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324672:0@lo:104: 00010000:00010000:3.0:1788535821.747416:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900580030c00/0xe79af2f39bbdc370 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc369 expref: 17 pid: 6526 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.747423:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324800:0@lo:104: 00010000:00010000:3.0:1788535821.747433:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc331 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc32a expref: 16 pid: 6529 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.747442:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569324928:0@lo:104: 00010000:00010000:3.0:1788535821.747451:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc300 expref: 15 pid: 6528 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535821.747459:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569325056:0@lo:104: 00000100:00100000:0.0:1788535821.747703:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569326336:0@lo:41: 00000100:00100000:0.0:1788535821.747751:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535821.747968:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569326336 00000100:00100000:1.0:1788535821.747976:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569326336 00000100:00100000:1.0:1788535821.748140:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788535821.748173:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569326336:12345-0@lo:41: 00000004:00000024:1.0:1788535821.748208:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788535821.748839:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569326336:12345-0@lo:41: Request processed in 667us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.748847:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788535821.748912:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569326336:0@lo:41: 00000100:00100000:2.0:1788535821.751683:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535821.751720:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535821.751825:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569323776:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535821.751836:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1875415569323904:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535821.751879:0:10345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.752938:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548302080 00000100:00100000:1.0:1788535821.752948:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548302080 00010000:00010000:1.0:1788535821.752985:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f7 expref: 10 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.753017:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548302208 00000100:00100000:1.0:1788535821.753020:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548302208 00010000:00010000:1.0:1788535821.753030:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f0 expref: 11 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535821.753053:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788535821.753063:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91b20ee6-59cb-4913-858f-bc518949fc4a+11:2401:x1875415548302080:12345-192.168.203.13@tcp:103: 00010000:00010000:1.0:1788535821.753084:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.753090:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f7 expref: 11 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753101:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f7 expref: 11 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753136:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e454c00/0xe79af2f39bbdc42d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f7 expref: 11 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753164:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.753215:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548302080:12345-192.168.203.13@tcp:103: Request processed in 153us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535821.753245:0:6520:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788535821.753255:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788535821.753311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788535821.753332:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1788535821.753338:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91b20ee6-59cb-4913-858f-bc518949fc4a+9:2402:x1875415548302208:12345-192.168.203.13@tcp:103: 00010000:00010000:1.0:1788535821.753345:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535821.753350:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f0 expref: 9 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753358:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f0 expref: 9 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753367:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e455c00/0xe79af2f39bbdc426 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16551f0 expref: 9 pid: 6529 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753378:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753385:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753396:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753411:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753417:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753424:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753429:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3fa00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788535821.753434:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753441:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753463:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535821.753471:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535821.753490:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91b20ee6-59cb-4913-858f-bc518949fc4a+8:2402:x1875415548302208:12345-192.168.203.13@tcp:103: Request processed in 153us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535821.753496:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00010000:00010000:2.0:1788535821.753575:0:10345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535821.753585:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535821.753591:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc46c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535822.508868:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535823.532499:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535823.740982:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535823.741023:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535823.741057:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535823.741092:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535823.741141:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535823.741246:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548302464 00000100:00100000:0.0:1788535823.741256:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548302464 00000100:00100000:0.0:1788535823.741317:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548302592 00000100:00100000:0.0:1788535823.741320:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548302592 00000100:00100000:0.0:1788535823.741341:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1788535823.741351:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548302464:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1788535823.741425:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548302464:12345-192.168.203.13@tcp:400: Request processed in 76us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.741433:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1788535823.741450:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1788535823.741457:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548302592:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1788535823.741480:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548302592:12345-192.168.203.13@tcp:400: Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.741486:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00080000:1.0:1788535823.741854:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535823.741859:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535823.742311:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548302336 00000100:00100000:2.0:1788535823.742317:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548302336 00000100:00100000:2.0:1788535823.742361:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:2.0:1788535823.742370:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+8:2401:x1875415548302336:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788535823.742407:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+8:2401:x1875415548302336:12345-192.168.203.13@tcp:400: Request processed in 39us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535823.742414:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:2.0:1788535823.742445:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548302720 00000100:00100000:2.0:1788535823.742448:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548302720 00000100:00100000:2.0:1788535823.742503:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548302848 00000100:00100000:2.0:1788535823.742507:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548302848 00000100:00100000:2.0:1788535823.742541:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788535823.742548:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548302720:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788535823.742584:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548302720:12345-192.168.203.13@tcp:400: Request processed in 26us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535823.742591:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788535823.742615:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788535823.742621:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548302848:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1788535823.742667:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548302848:12345-192.168.203.13@tcp:400: Request processed in 45us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535823.742673:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00080000:1.0:1788535823.743101:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535823.743106:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788535823.789735:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788535823.789742:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff900485fef800 from 48 10000000:01000000:3.0:1788535823.789748:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788535823.789823:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.790242:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.790255:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535823.790279:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569326464:0@lo:101: 00000100:00100000:3.0:1788535823.790342:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.790383:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005831730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.791361:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569326464 00000100:00100000:1.0:1788535823.791371:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569326464 00000100:00100000:1.0:1788535823.791434:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788535823.791444:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+15:6531:x1875415569326464:12345-0@lo:101: 00010000:00010000:1.0:1788535823.791458:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535823.791474:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e440e00/0xe79af2f39bbdc47a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc473 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.791497:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e440e00/0xe79af2f39bbdc47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc473 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.791508:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e440e00/0xe79af2f39bbdc47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc473 expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.791526:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e440e00, rc 0) 00000100:00100000:1.0:1788535823.791590:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569326464:12345-0@lo:101: Request processed in 147us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.791596:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788535823.791646:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569326464:0@lo:101: 00010000:00010000:1.0:1788535823.791660:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.791669:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535823.791749:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569326592:0@lo:501: 00000100:00100000:1.0:1788535823.791798:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.791823:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.792354:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569326592 00000100:00100000:1.0:1788535823.792360:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569326592 00000100:00100000:1.0:1788535823.792392:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788535823.792400:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569326592:12345-0@lo:501: 00000100:00100000:1.0:1788535823.792534:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569326592:12345-0@lo:501: Request processed in 134us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.792541:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788535823.792589:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569326592:0@lo:501: 00000100:00100000:1.0:1788535823.792620:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569326720:0@lo:503: 00000100:00100000:1.0:1788535823.792662:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.795409:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569326720 00000100:00100000:3.0:1788535823.795422:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569326720 00000100:00100000:3.0:1788535823.795482:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788535823.796086:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569326720:12345-0@lo:503: 00000100:00100000:3.0:1788535823.796280:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569326720:12345-0@lo:503: Request processed in 790us (3617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.796288:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788535823.798790:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.799060:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569326720:0@lo:503: 00000100:00100000:1.0:1788535823.803648:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10364:1875415569326848:0@lo:502: 00000100:00100000:1.0:1788535823.803730:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.803776:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.803862:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569326848 00000100:00100000:3.0:1788535823.803870:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569326848 00000100:00100000:3.0:1788535823.803922:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788535823.803932:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:10364:x1875415569326848:12345-0@lo:502: 00000100:00100000:3.0:1788535823.804076:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+16:10364:x1875415569326848:12345-0@lo:502: Request processed in 145us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.804084:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788535823.804373:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10364:1875415569326848:0@lo:502: 00000100:00100000:0.0:1788535823.804422:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10364:1875415569326976:0@lo:502: 00000100:00100000:0.0:1788535823.804457:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.804486:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.804640:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569326976 00000100:00100000:3.0:1788535823.804645:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569326976 00000100:00100000:3.0:1788535823.804680:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788535823.804695:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:10364:x1875415569326976:12345-0@lo:502: 00000100:00100000:3.0:1788535823.804767:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+16:10364:x1875415569326976:12345-0@lo:502: Request processed in 72us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.804774:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788535823.804862:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10364:1875415569326976:0@lo:502: 00000040:00080000:0.0:1788535823.804884:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788535823.805174:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788535823.805196:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788535823.805205:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.805216:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535823.805225:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788535823.805228:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788535823.805230:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788535823.805255:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.805264:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.805273:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535823.805289:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327104:0@lo:101: 00000100:00100000:3.0:1788535823.805321:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.805347:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173840 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.805471:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569327104 00000100:00100000:1.0:1788535823.805477:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569327104 00000100:00100000:1.0:1788535823.805520:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788535823.805528:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+16:6531:x1875415569327104:12345-0@lo:101: 00010000:00010000:1.0:1788535823.805537:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535823.805549:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e440800/0xe79af2f39bbdc488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc481 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.805590:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e440800/0xe79af2f39bbdc488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc481 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.805601:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e440800/0xe79af2f39bbdc488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc481 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.805609:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e440800, rc 0) 00000100:00100000:1.0:1788535823.805643:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569327104:12345-0@lo:101: Request processed in 116us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.805649:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788535823.807240:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327104:0@lo:101: 00010000:00010000:3.0:1788535823.807266:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.807296:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535823.807378:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327232:0@lo:501: 00000100:00100000:3.0:1788535823.807431:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.807462:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173840 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.807882:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569327232 00000100:00100000:1.0:1788535823.807890:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569327232 00000100:00100000:1.0:1788535823.807935:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788535823.807944:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569327232:12345-0@lo:501: 00000100:00100000:1.0:1788535823.808090:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569327232:12345-0@lo:501: Request processed in 146us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.808098:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788535823.808360:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327232:0@lo:501: 00000100:00100000:3.0:1788535823.808394:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327360:0@lo:503: 00000100:00100000:3.0:1788535823.808436:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.808469:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173840 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.808528:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569327360 00000100:00100000:0.0:1788535823.808532:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569327360 00000100:00100000:0.0:1788535823.808557:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788535823.808574:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569327360:12345-0@lo:503: 00000100:00100000:0.0:1788535823.808666:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569327360:12345-0@lo:503: Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.808673:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788535823.808817:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327360:0@lo:503: 00000100:00100000:3.0:1788535823.809730:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10365:1875415569327488:0@lo:502: 00000100:00100000:3.0:1788535823.809796:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.809839:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173900 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.810055:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569327488 00000100:00100000:0.0:1788535823.810062:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569327488 00000100:00100000:0.0:1788535823.810103:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788535823.810111:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:10365:x1875415569327488:12345-0@lo:502: 00000100:00100000:0.0:1788535823.810247:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+17:10365:x1875415569327488:12345-0@lo:502: Request processed in 136us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.810254:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788535823.812283:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10365:1875415569327488:0@lo:502: 00000020:01000000:1.0:1788535823.812329:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535823.812341:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535823.812344:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788535823.812352:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788535823.812392:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10365:1875415569327616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.812460:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.812502:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.812710:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569327616 00000100:00100000:3.0:1788535823.812718:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569327616 00000100:00100000:3.0:1788535823.812783:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788535823.812793:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:10365:x1875415569327616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.812936:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+17:10365:x1875415569327616:12345-0@lo:502:llog_process_th.0 Request processed in 143us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.812943:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788535823.813122:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10365:1875415569327616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535823.813173:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535823.813178:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535823.813180:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788535823.813185:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788535823.813683:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788535823.813704:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788535823.813715:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.813735:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535823.813744:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788535823.813747:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005893a3800 from 48 10000000:01000000:3.0:1788535823.813749:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788535823.813788:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.813797:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.813805:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535823.813824:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.814033:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.814070:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.814119:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569327744 00000100:00100000:0.0:1788535823.814125:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569327744 00000100:00100000:0.0:1788535823.814197:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788535823.814205:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+17:6531:x1875415569327744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535823.814214:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535823.814225:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e454400/0xe79af2f39bbdc496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc48f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.814245:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e454400/0xe79af2f39bbdc496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc48f expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.814255:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e454400/0xe79af2f39bbdc496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc48f expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.814264:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454400, rc 0) 00000100:00100000:0.0:1788535823.814297:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569327744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.814303:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788535823.814404:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535823.814427:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.814437:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535823.814497:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.814535:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.814627:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.815223:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569327872 00000100:00100000:3.0:1788535823.815229:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569327872 00000100:00100000:3.0:1788535823.815267:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788535823.815274:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569327872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.815400:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569327872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.815406:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788535823.815715:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569327872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.815755:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569328000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.815812:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535823.816034:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.816689:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569328000 00000100:00100000:0.0:1788535823.816696:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569328000 00000100:00100000:0.0:1788535823.816731:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788535823.816740:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569328000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.817053:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569328000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 313us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.817061:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788535823.817376:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569328000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.818061:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10366:1875415569328128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.818114:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.818179:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.818301:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569328128 00000100:00100000:0.0:1788535823.818308:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569328128 00000100:00100000:0.0:1788535823.818348:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788535823.818355:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:10366:x1875415569328128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535823.818462:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+18:10366:x1875415569328128:12345-0@lo:502:llog_process_th.0 Request processed in 107us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.818469:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788535823.818660:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10366:1875415569328128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.818701:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10366:1875415569328256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.818734:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.818807:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.821423:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569328256 00000100:00100000:1.0:1788535823.821438:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569328256 00000100:00100000:1.0:1788535823.821537:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788535823.821549:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:10366:x1875415569328256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.821791:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+18:10366:x1875415569328256:12345-0@lo:502:llog_process_th.0 Request processed in 243us (3055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.821799:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788535823.822286:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10366:1875415569328256:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788535823.822324:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788535823.822632:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788535823.822661:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788535823.822672:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535823.822683:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535823.822695:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788535823.822697:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788535823.822700:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788535823.822739:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535823.822748:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535823.822757:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535823.822946:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569328384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.823090:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535823.823199:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.823347:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569328384 00000100:00100000:1.0:1788535823.823354:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569328384 00000100:00100000:1.0:1788535823.823395:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788535823.823403:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+18:6531:x1875415569328384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535823.823414:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535823.823426:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e441600/0xe79af2f39bbdc4a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc49d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.823448:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e441600/0xe79af2f39bbdc4a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc49d expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.823458:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e441600/0xe79af2f39bbdc4a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc49d expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.823474:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e441600, rc 0) 00000100:00100000:1.0:1788535823.823528:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569328384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.823534:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788535823.823688:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569328384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535823.823703:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535823.823713:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535823.823817:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569328512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.827566:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.827612:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.827665:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569328512 00000100:00100000:1.0:1788535823.827675:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569328512 00000100:00100000:1.0:1788535823.827761:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788535823.827771:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569328512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.827959:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569328512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.827978:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788535823.828306:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569328512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.828357:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569328640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.828408:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.837244:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569328640 00000100:00100000:0.0:1788535823.837258:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569328640 00000100:00100000:1.0:1788535823.837318:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788535823.837333:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569328640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.837493:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569328640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (9084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.837501:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788535823.839452:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.839492:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569328640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.845259:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10367:1875415569328768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535823.845336:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535823.845381:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.845498:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569328768 00000100:00100000:1.0:1788535823.845505:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569328768 00000100:00100000:1.0:1788535823.845574:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788535823.845584:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+19:10367:x1875415569328768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.845702:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+19:10367:x1875415569328768:12345-0@lo:502:llog_process_th.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.845710:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788535823.846000:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10367:1875415569328768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535823.846030:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535823.846039:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535823.846041:0:10367:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788535823.846051:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788535823.846072:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10367:1875415569328896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535823.846104:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535823.846129:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.846170:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569328896 00000100:00100000:0.0:1788535823.846292:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569328896 00000100:00100000:1.0:1788535823.846425:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788535823.846439:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+19:10367:x1875415569328896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.846669:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+19:10367:x1875415569328896:12345-0@lo:502:llog_process_th.0 Request processed in 231us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.846679:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788535823.846689:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10367:1875415569328896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535823.846711:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535823.846717:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535823.846719:0:10367:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788535823.846722:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1788535823.848077:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788535823.848105:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788535823.848116:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.848128:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535823.848138:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788535823.848141:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005831a8000 from 48 10000000:01000000:3.0:1788535823.848173:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788535823.848208:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.848227:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.848237:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535823.848260:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.848309:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.848349:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.848428:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569329024 00000100:00100000:1.0:1788535823.848435:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569329024 00000100:00100000:1.0:1788535823.848763:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788535823.848772:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+19:6531:x1875415569329024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535823.848784:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535823.848796:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e440a00/0xe79af2f39bbdc4b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc4ab expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.848818:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e440a00/0xe79af2f39bbdc4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4ab expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.848828:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e440a00/0xe79af2f39bbdc4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4ab expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.848836:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e440a00, rc 0) 00000100:00100000:1.0:1788535823.848884:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569329024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.848891:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788535823.849055:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535823.849070:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.849080:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535823.849137:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.849198:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.849228:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.849415:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569329152 00000100:00100000:0.0:1788535823.849421:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569329152 00000100:00100000:0.0:1788535823.849583:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788535823.849592:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569329152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.849722:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569329152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535823.849730:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788535823.849840:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.849880:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.849932:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535823.853740:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.853828:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569329280 00000100:00100000:3.0:1788535823.853931:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569329280 00000100:00100000:3.0:1788535823.853978:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788535823.853987:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569329280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.854235:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569329280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (4308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.854243:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788535823.854415:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.855009:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10368:1875415569329408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.855060:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.855127:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583173600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535823.855293:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569329408 00000100:00100000:2.0:1788535823.855299:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569329408 00000100:00100000:3.0:1788535823.855392:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788535823.855400:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:10368:x1875415569329408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.855665:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:10368:x1875415569329408:12345-0@lo:502:llog_process_th.0 Request processed in 264us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.855671:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788535823.855731:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10368:1875415569329408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535823.855771:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10368:1875415569329536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535823.855995:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535823.856057:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.856090:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569329536 00000100:00100000:3.0:1788535823.856094:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569329536 00000100:00100000:3.0:1788535823.856115:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788535823.856122:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:10368:x1875415569329536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.857032:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:10368:x1875415569329536:12345-0@lo:502:llog_process_th.0 Request processed in 906us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.857040:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788535823.857125:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10368:1875415569329536:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788535823.857188:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788535823.857316:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788535823.857332:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788535823.857340:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535823.857358:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535823.857368:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788535823.857370:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788535823.857372:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788535823.857400:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535823.857408:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535823.857418:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535823.857437:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.857472:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535823.857508:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.857551:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569329664 00000100:00100000:1.0:1788535823.857557:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569329664 00000100:00100000:1.0:1788535823.857605:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788535823.857614:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569329664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535823.857625:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535823.857645:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e441200/0xe79af2f39bbdc4c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc4b9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.857667:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e441200/0xe79af2f39bbdc4c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4b9 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.857677:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e441200/0xe79af2f39bbdc4c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4b9 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535823.857684:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e441200, rc 0) 00000100:00100000:1.0:1788535823.858834:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569329664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1216us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.858843:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788535823.859079:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535823.859101:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.859113:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.860485:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.860556:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.860603:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.860664:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569329792 00000100:00100000:1.0:1788535823.860671:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569329792 00000100:00100000:1.0:1788535823.860726:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788535823.860734:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569329792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.860856:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569329792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.860864:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788535823.861019:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.861050:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.861100:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.861122:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.861191:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569329920 00000100:00100000:3.0:1788535823.861197:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569329920 00000100:00100000:3.0:1788535823.861237:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788535823.861244:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569329920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.861357:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569329920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.861364:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788535823.861455:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569329920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.863129:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10369:1875415569330048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.863239:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.863274:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.863666:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569330048 00000100:00100000:3.0:1788535823.863673:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569330048 00000100:00100000:3.0:1788535823.863727:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788535823.863738:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:10369:x1875415569330048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.863865:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:10369:x1875415569330048:12345-0@lo:502:llog_process_th.0 Request processed in 129us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.863873:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788535823.863954:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10369:1875415569330048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535823.863985:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535823.863993:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535823.863996:0:10369:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788535823.864002:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788535823.864031:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10369:1875415569330176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.864067:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.864105:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.864168:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569330176 00000100:00100000:3.0:1788535823.864173:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569330176 00000100:00100000:3.0:1788535823.864328:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788535823.864335:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:10369:x1875415569330176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.864415:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:10369:x1875415569330176:12345-0@lo:502:llog_process_th.0 Request processed in 79us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.864422:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788535823.864447:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10369:1875415569330176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535823.864469:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535823.864473:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535823.864475:0:10369:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788535823.864479:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788535823.864848:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788535823.864871:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788535823.864881:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.864891:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535823.864900:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788535823.864903:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9005831fb800 from 48 10000000:01000000:0.0:1788535823.864905:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788535823.864930:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.864939:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.864947:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.864962:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569330304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.864995:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.865036:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.865328:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569330304 00000100:00100000:3.0:1788535823.865335:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569330304 00000100:00100000:3.0:1788535823.865373:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788535823.865381:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569330304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535823.865390:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535823.865402:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3f200/0xe79af2f39bbdc4ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc4c7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.865423:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3f200/0xe79af2f39bbdc4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4c7 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.865432:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3f200/0xe79af2f39bbdc4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4c7 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.865440:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3f200, rc 0) 00000100:00100000:3.0:1788535823.865480:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569330304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.865496:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788535823.865580:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569330304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535823.865594:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.865602:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.865653:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569330432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.865678:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.865781:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569330432 00000100:00100000:3.0:1788535823.865785:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569330432 00000100:00100000:3.0:1788535823.865817:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788535823.865824:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569330432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.865913:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569330432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.865920:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788535823.865963:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788535823.865975:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569330432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.866000:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569330560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.866035:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.866056:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788535823.866347:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569330560 00000100:00100000:1.0:1788535823.866353:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569330560 00000100:00100000:1.0:1788535823.866383:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788535823.866391:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569330560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.866479:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569330560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535823.866486:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788535823.866979:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569330560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.868537:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10370:1875415569330688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535823.868607:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535823.868650:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.869397:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569330688 00000100:00100000:3.0:1788535823.869406:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569330688 00000100:00100000:3.0:1788535823.869459:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788535823.869468:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:10370:x1875415569330688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.869617:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:10370:x1875415569330688:12345-0@lo:502:llog_process_th.0 Request processed in 149us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.869625:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788535823.871096:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10370:1875415569330688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.871365:0:10370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10370:1875415569330816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.871431:0:10370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535823.871472:0:10370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005893f3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535823.871496:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569330816 00000100:00100000:2.0:1788535823.871503:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569330816 00000100:00100000:2.0:1788535823.871547:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788535823.871555:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:10370:x1875415569330816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535823.871685:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:10370:x1875415569330816:12345-0@lo:502:llog_process_th.0 Request processed in 130us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.871981:0:10370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10370:1875415569330816:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788535823.872005:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788535823.877407:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788535823.877443:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788535823.877455:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.877468:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535823.877633:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 10000000:01000000:2.0:1788535823.878203:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788535823.878208:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1788535823.878213:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788535823.878258:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535823.878269:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535823.878280:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535823.878307:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569330944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.878378:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535823.878419:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.878460:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569330944 00000100:00100000:3.0:1788535823.878468:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569330944 00000100:00100000:3.0:1788535823.878532:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788535823.878540:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569330944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535823.878553:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535823.878576:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc4dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc4d5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.878599:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc4dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4d5 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.878610:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc4dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4d5 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.878619:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3fa00, rc 0) 00000100:00100000:3.0:1788535823.878664:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569330944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.878670:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788535823.878753:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569330944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535823.878768:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.878784:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.878841:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569331072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.878870:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.878893:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.878939:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569331072 00000100:00100000:3.0:1788535823.878944:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569331072 00000100:00100000:3.0:1788535823.878962:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788535823.878967:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569331072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.879079:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569331072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.879086:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788535823.879412:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569331072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.879440:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569331200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.879478:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.879501:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.879998:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569331200 00000100:00100000:3.0:1788535823.880005:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569331200 00000100:00100000:3.0:1788535823.880041:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788535823.880048:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569331200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535823.880340:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569331200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.880349:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788535823.880439:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569331200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535823.882907:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10371:1875415569331328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.883044:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.883085:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1a59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.883427:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569331328 00000100:00100000:3.0:1788535823.883441:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569331328 00000100:00100000:3.0:1788535823.883478:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788535823.883486:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:10371:x1875415569331328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535823.883627:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:10371:x1875415569331328:12345-0@lo:502:llog_process_th.0 Request processed in 141us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.883635:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788535823.884039:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10371:1875415569331328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535823.884071:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788535823.884081:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535823.884084:0:10371:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788535823.884089:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788535823.884116:0:10371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10371:1875415569331456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535823.884189:0:10371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535823.884964:0:10371:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1a59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535823.885001:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569331456 00000100:00100000:2.0:1788535823.885007:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569331456 00000100:00100000:2.0:1788535823.885052:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788535823.885062:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:10371:x1875415569331456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535823.885357:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:10371:x1875415569331456:12345-0@lo:502:llog_process_th.0 Request processed in 295us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535823.885375:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788535823.885472:0:10371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10371:1875415569331456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788535823.885504:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788535823.885520:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788535823.885522:0:10371:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788535823.885527:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788535823.885928:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788535823.885952:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788535823.885962:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.885974:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535823.885984:0:6531:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788535823.885987:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9005baf299c0 from 1 10000000:01000000:0.0:1788535823.885990:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788535823.886021:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.886029:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.886045:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.886066:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569331584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.886106:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.889258:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535823.889427:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569331584 00000100:00100000:3.0:1788535823.889437:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569331584 00000100:00100000:3.0:1788535823.889495:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788535823.889505:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569331584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535823.889531:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535823.889550:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc4ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc4e3 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.889577:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4e3 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.889588:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc4e3 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535823.889597:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50000, rc 0) 00000100:00100000:3.0:1788535823.889651:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569331584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535823.889657:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788535823.889850:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569331584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535823.889867:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4ea expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.889876:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4ea expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535823.889945:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569331712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535823.889979:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535823.890010:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535823.890059:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569331712 00000100:00100000:2.0:1788535823.890064:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569331712 00000100:00100000:2.0:1788535823.890097:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788535823.890104:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569331712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535823.890213:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569331712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (232us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788535823.890250:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788535823.890469:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569331712:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788535823.890498:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788535823.890505:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4ea expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535823.890523:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4ea expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535824.301608:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569331840:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.301685:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.301750:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569332352:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.301775:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.301793:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569332864:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.301815:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.301831:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569333376:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.301850:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.301873:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788535824.301879:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569331968:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.301901:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.301918:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569332480:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.301938:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.301957:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569332992:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.301977:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.302002:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569332224:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.302024:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.302038:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569332736:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.302058:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.302071:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569333248:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.302089:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.302106:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788535824.302112:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569332096:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.302131:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.302170:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569332608:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.302213:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.302230:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569333120:0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.302250:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.302274:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569331968 00000100:00100000:0.0:1788535824.302282:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569331968 00000100:00100000:0.0:1788535824.302316:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569332480 00000100:00100000:0.0:1788535824.302319:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569332480 00000100:00100000:0.0:1788535824.302338:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569332992 00000100:00100000:0.0:1788535824.302341:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569332992 00000100:00100000:0.0:1788535824.302353:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569332224 00000100:00100000:0.0:1788535824.302355:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569332224 00000100:00100000:0.0:1788535824.302364:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569332608 00000100:00100000:0.0:1788535824.302366:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569332608 00000100:00100000:0.0:1788535824.302376:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569333120 00000100:00100000:0.0:1788535824.302378:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569333120 00000100:00100000:0.0:1788535824.302394:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788535824.302418:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569331968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535824.302470:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569331968:12345-0@lo:400:kworker.0 Request processed in 68us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535824.302478:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788535824.302607:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569332352 00000100:00100000:3.0:1788535824.302612:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569332352 00000100:00100000:3.0:1788535824.302633:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569332096 00000100:00100000:3.0:1788535824.302636:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569332096 00000100:00100000:3.0:1788535824.302648:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535824.302663:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569332352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.302701:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569332352:12345-0@lo:400:kworker.0 Request processed in 40us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.302707:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535824.302720:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788535824.302726:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569332096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.302758:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569332096:12345-0@lo:400:kworker.0 Request processed in 33us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.302764:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788535824.302782:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569332864 00000100:00100000:3.0:1788535824.302786:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569332864 00000100:00100000:3.0:1788535824.302804:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569333376 00000100:00100000:3.0:1788535824.302806:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569333376 00000100:00100000:3.0:1788535824.302817:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569332736 00000100:00100000:3.0:1788535824.302819:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569332736 00000100:00100000:3.0:1788535824.302830:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569333248 00000100:00100000:3.0:1788535824.302832:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569333248 00000100:00100000:3.0:1788535824.302845:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788535824.302851:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569332864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.302881:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569332864:12345-0@lo:400:kworker.0 Request processed in 29us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.302887:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788535824.302897:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788535824.302902:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569333376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.302925:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569333376:12345-0@lo:400:kworker.0 Request processed in 23us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.302930:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788535824.302946:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788535824.302951:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569332736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.302976:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569332736:12345-0@lo:400:kworker.0 Request processed in 25us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.302981:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788535824.302990:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788535824.302995:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569333248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303029:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569333248:12345-0@lo:400:kworker.0 Request processed in 33us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.303034:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788535824.303054:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535824.303061:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569332480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303088:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569332480:12345-0@lo:400:kworker.0 Request processed in 28us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.303094:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535824.303105:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788535824.303110:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569332992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303131:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569332992:12345-0@lo:400:kworker.0 Request processed in 22us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.303136:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788535824.303162:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788535824.303168:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569332224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303190:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569332224:12345-0@lo:400:kworker.0 Request processed in 23us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.303195:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788535824.303214:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788535824.303220:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569332608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303248:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569332608:12345-0@lo:400:kworker.0 Request processed in 28us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.303253:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788535824.303264:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788535824.303269:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569333120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303290:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569333120:12345-0@lo:400:kworker.0 Request processed in 22us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.303296:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788535824.303320:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569331840 00000100:00100000:3.0:1788535824.303323:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569331840 00000100:00100000:3.0:1788535824.303344:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788535824.303349:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569331840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303372:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569331840:12345-0@lo:400:kworker.0 Request processed in 23us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535824.303376:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788535824.303433:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569331968:0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303442:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569332480:0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303451:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569332992:0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303458:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569331840:0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303466:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569332352:0@lo:400:kworker.0 00010000:00080000:3.0:1788535824.303476:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894aed80 x1875415569332864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788535824.303773:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535824.303777:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535824.303780:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535824.303782:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535824.303806:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569332096:0@lo:400:kworker.0 00010000:00080000:1.0:1788535824.303816:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ac380 x1875415569332608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535824.303826:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569332608:0@lo:400:kworker.0 00010000:00080000:1.0:1788535824.303835:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ac700 x1875415569333120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535824.303843:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569333120:0@lo:400:kworker.0 00000100:00100000:1.0:1788535824.303850:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569332224:0@lo:400:kworker.0 00010000:00080000:1.0:1788535824.303859:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ae300 x1875415569332736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535824.303866:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569332736:0@lo:400:kworker.0 00010000:00080000:1.0:1788535824.303874:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ad500 x1875415569333248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535824.303881:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569333248:0@lo:400:kworker.0 00000100:00100000:3.0:1788535824.303950:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569332864:0@lo:400:kworker.0 00010000:00080000:3.0:1788535824.303963:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e562d80 x1875415569333376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535824.303970:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569333376:0@lo:400:kworker.0 00010000:00010000:0.0:1788535824.557004:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535824.812420:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535824.812456:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569333504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535824.812544:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535824.812738:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569333504 00000100:00100000:1.0:1788535824.812747:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569333504 00000100:00100000:1.0:1788535824.812825:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535824.812835:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569333504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535824.812862:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535824.812921:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569333504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535824.812928:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535824.813604:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569333632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535824.813659:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535824.813764:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569333632 00000100:00100000:0.0:1788535824.813770:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569333632 00000100:00100000:0.0:1788535824.813797:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788535824.813803:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569333632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535824.813816:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535824.813859:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569333632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535824.813865:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788535824.814034:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487ad2300 x1875415569333632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535824.814052:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569333632:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788535824.814139:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14fb80 x1875415569333504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535824.814180:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569333504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788535825.580533:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535825.836408:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535825.836431:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569333760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535825.836517:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535825.836614:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569333888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535825.836640:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535825.836678:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569333760 00000100:00100000:3.0:1788535825.836683:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569333888 00000100:00100000:0.0:1788535825.836687:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569333760 00000100:00100000:3.0:1788535825.836690:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569333888 00000100:00100000:0.0:1788535825.836738:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788535825.836748:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569333888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788535825.836776:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535825.836835:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569333888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535825.836842:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788535825.836859:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788535825.836866:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569333760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535825.836877:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535825.836910:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569333760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535825.836916:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788535825.837095:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e562300 x1875415569333760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535825.837115:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569333760:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788535825.837196:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e561880 x1875415569333888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535825.837217:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569333888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535826.348796:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535826.348821:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569334016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788535826.348894:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535826.349028:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569334016 00000100:00100000:0.0:1788535826.349035:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569334016 00000100:00100000:0.0:1788535826.349095:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788535826.349104:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569334016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788535826.349136:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535826.349207:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569334016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535826.349214:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788535826.349360:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569334016:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788535826.604450:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535826.860663:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569334144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535826.860735:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535826.860869:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569334144 00000100:00100000:0.0:1788535826.860878:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569334144 00000100:00100000:0.0:1788535826.860927:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788535826.860936:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569334144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788535826.860969:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788535826.861036:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569334144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535826.861043:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788535826.861174:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569334144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535827.322098:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535827.322311:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548302976 00000100:00100000:3.0:1788535827.322321:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548302976 00000100:00100000:3.0:1788535827.322420:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:3.0:1788535827.322445:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+8:6172:x1875415548302976:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1788535827.322463:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535827.322483:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc4f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655267 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535827.322538:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655267 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535827.322549:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655267 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535827.322557:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51e00, rc 0) 00000100:00100000:3.0:1788535827.322728:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6172:x1875415548302976:12345-192.168.203.13@tcp:101: Request processed in 285us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535827.322736:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:3.0:1788535827.336652:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535827.336751:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548303104 00000100:00100000:2.0:1788535827.336761:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548303104 00000100:00100000:2.0:1788535827.336822:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:2.0:1788535827.336832:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6172:x1875415548303104:12345-192.168.203.13@tcp:501: 00000100:00100000:2.0:1788535827.337002:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6172:x1875415548303104:12345-192.168.203.13@tcp:501: Request processed in 171us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535827.337010:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:0.0:1788535827.346038:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535827.346120:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548303232 00000100:00100000:3.0:1788535827.346131:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548303232 00000100:00100000:3.0:1788535827.346230:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 244 00000100:00100000:3.0:1788535827.346241:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6172:x1875415548303232:12345-192.168.203.13@tcp:503: 00000100:00100000:3.0:1788535827.346386:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6172:x1875415548303232:12345-192.168.203.13@tcp:503: Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535827.346394:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 244 00000100:00100000:3.0:1788535827.352984:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535827.355335:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548303360 00000100:00100000:1.0:1788535827.355351:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548303360 00000100:00100000:1.0:1788535827.355578:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 245 00000100:00100000:1.0:1788535827.355598:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6677:x1875415548303360:12345-192.168.203.13@tcp:502: 00000100:00100000:1.0:1788535827.355791:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6677:x1875415548303360:12345-192.168.203.13@tcp:502: Request processed in 195us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535827.355799:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 245 00000100:00100000:0.0:1788535827.370387:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535827.370544:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548303488 00000100:00100000:2.0:1788535827.370554:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548303488 00000100:00100000:2.0:1788535827.370611:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:2.0:1788535827.370621:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6677:x1875415548303488:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788535827.370765:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6677:x1875415548303488:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 144us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535827.370773:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:0.0:1788535827.374243:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535827.374685:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548303616 00000100:00100000:1.0:1788535827.375032:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548303616 00000100:00100000:1.0:1788535827.375094:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:1.0:1788535827.375103:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6172:x1875415548303616:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535827.375119:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535827.375136:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e441e00/0xe79af2f39bbdc4f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b165526e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535827.375190:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e441e00/0xe79af2f39bbdc4f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165526e expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535827.375202:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e441e00/0xe79af2f39bbdc4f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165526e expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535827.375211:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e441e00, rc 0) 00000100:00100000:1.0:1788535827.375268:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6172:x1875415548303616:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 166us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535827.375274:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:1.0:1788535827.377666:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535827.377734:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548303744 00000100:00100000:3.0:1788535827.377743:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548303744 00000100:00100000:3.0:1788535827.377794:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 248 00000100:00100000:3.0:1788535827.377803:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6172:x1875415548303744:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535827.377920:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6172:x1875415548303744:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 119us (263us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788535827.377944:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 248 00010000:00010000:0.0:1788535827.628445:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535828.653420:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535828.858785:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535828.858837:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535828.858890:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535828.858928:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535828.858962:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535828.859064:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548304000 00000100:00100000:3.0:1788535828.859073:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548304000 00000100:00100000:1.0:1788535828.859229:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548304256 00000100:00100000:1.0:1788535828.859235:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548304256 00000100:00100000:1.0:1788535828.859281:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548304384 00000100:00100000:3.0:1788535828.859284:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548304128 00000100:00100000:1.0:1788535828.859285:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548304384 00000100:00100000:3.0:1788535828.859297:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548304128 00000100:00100000:1.0:1788535828.859318:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1788535828.859343:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548304256:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535828.859412:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548304256:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535828.859421:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1788535828.859426:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:1.0:1788535828.859444:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1788535828.859448:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2399:x1875415548304000:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535828.859467:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548304384:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535828.859508:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2399:x1875415548304000:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535828.859514:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548304384:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 58us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535828.859521:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:3.0:1788535828.859545:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:3.0:1788535828.859560:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548304128:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535828.859638:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00080000:0.0:1788535828.860444:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788535828.860451:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535828.860453:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535828.860455:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535828.860623:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548303872 00000100:00100000:2.0:1788535828.860642:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548303872 00000100:00100000:2.0:1788535828.860682:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:2.0:1788535828.860691:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2399:x1875415548303872:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535828.860729:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2399:x1875415548303872:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 39us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535828.860736:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:3.0:1788535828.863853:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548304128:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 4287us (4911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535828.863868:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000020:00000080:3.0:1788535829.026442:0:10408:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceebc2720 20000000:00000080:3.0:1788535829.026460:0:10408:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90059e75a000 uarg=0000000000000000 20000000:01000000:3.0:1788535829.026517:0:10408:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788535829.026523:0:10408:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788535829.026527:0:10408:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788535829.028042:0:10409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788535829.028357:0:10408:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788535829.034698:0:10408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788535829.034739:0:10408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788535829.034758:0:10408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788535829.034774:0:10408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788535829.034794:0:10408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.034823:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc147 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc140 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.034830:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc194 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.034836:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc1f6 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.034843:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc31c expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.034852:0:10408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165522f expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.034859:0:10408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.035032:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165522f expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.035048:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165522f expref: 9 pid: 6528 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.035063:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334272:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535829.036073:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc31c expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.036095:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc31c expref: 23 pid: 6529 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.036119:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334400:0@lo:104: 00000100:00100000:3.0:1788535829.036190:0:10408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535829.036224:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc1f6 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.036233:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1f6 expref: 23 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.036242:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334528:0@lo:104: 00000100:00100000:3.0:1788535829.036269:0:10408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788535829.036296:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc194 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.036305:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc194 expref: 23 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.036314:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334656:0@lo:104: 00010000:00010000:3.0:1788535829.036342:0:10408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc147 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc140 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.036350:0:10408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc140 expref: 23 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.036358:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334784:0@lo:104: 00000100:00100000:3.0:1788535829.036531:0:10408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788535829.036645:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788535829.036664:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.036679:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.036689:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569334400 00000100:00100000:1.0:1788535829.036696:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569334400 00000100:00100000:1.0:1788535829.036731:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569334528 00000100:00100000:1.0:1788535829.036734:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569334528 00000100:00100000:1.0:1788535829.036743:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569334656 00000100:00100000:1.0:1788535829.036745:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569334656 00000100:00100000:1.0:1788535829.036753:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569334784 00000100:00100000:1.0:1788535829.036755:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569334784 00000100:00100000:1.0:1788535829.036767:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788535829.036775:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e560e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+6:10408:x1875415569334400:12345-0@lo:104: 00010000:00010000:1.0:1788535829.036788:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.036857:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788535829.036864:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e560e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+6:10408:x1875415569334400:12345-0@lo:104: Request processed in 90us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.036880:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788535829.036908:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788535829.036915:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+5:10408:x1875415569334528:12345-0@lo:104: 00010000:00010000:1.0:1788535829.036923:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.036959:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788535829.036964:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+5:10408:x1875415569334528:12345-0@lo:104: Request processed in 50us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.036970:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788535829.037004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788535829.037011:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:10408:x1875415569334656:12345-0@lo:104: 00010000:00010000:1.0:1788535829.037019:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037052:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788535829.037057:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:10408:x1875415569334656:12345-0@lo:104: Request processed in 47us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.037063:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788535829.037075:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788535829.037081:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:10408:x1875415569334784:12345-0@lo:104: 00010000:00010000:1.0:1788535829.037089:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037114:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788535829.037119:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:10408:x1875415569334784:12345-0@lo:104: Request processed in 39us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.037131:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788535829.037174:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788535829.037179:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037186:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454000 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535829.037190:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037198:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535829.037206:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535829.037212:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535829.037243:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037250:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535829.037269:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037275:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e454000/0xe79af2f39bbdc31c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc323 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037287:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788535829.037290:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037305:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461e00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535829.037308:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037314:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535829.037320:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535829.037326:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535829.037340:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037345:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535829.037360:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037367:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e461e00/0xe79af2f39bbdc1f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc1fd expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037376:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788535829.037393:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037400:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50800 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535829.037402:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037420:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535829.037426:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535829.037432:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535829.037446:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037452:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535829.037458:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037464:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058af50800/0xe79af2f39bbdc194 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc19b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037483:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535829.037487:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037492:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632fe00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535829.037495:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037501:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535829.037507:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535829.037519:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535829.037534:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037540:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535829.037546:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037553:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbdc140 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc147 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037565:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535829.037567:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535829.037569:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535829.037590:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569334912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535829.037626:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.037661:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535829.037667:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569335296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535829.037687:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.037715:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569335040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535829.037738:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.037757:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535829.037765:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569335168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535829.037786:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.037811:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569334912 00000100:00100000:1.0:1788535829.037816:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569334912 00010000:00010000:1.0:1788535829.037837:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc31c expref: 24 pid: 6529 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535829.037860:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569335296 00000100:00100000:1.0:1788535829.037863:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569335296 00010000:00010000:1.0:1788535829.037874:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc147 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc140 expref: 25 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535829.037884:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569335040 00000100:00100000:1.0:1788535829.037887:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569335040 00010000:00010000:1.0:1788535829.037895:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1f6 expref: 26 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535829.037904:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569335168 00000100:00100000:1.0:1788535829.037905:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569335168 00010000:00010000:1.0:1788535829.037913:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc194 expref: 27 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535829.037923:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788535829.037930:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+27:3663:x1875415569334912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535829.037940:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535829.037945:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc31c expref: 27 pid: 6529 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037953:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc31c expref: 27 pid: 6529 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.037967:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535829.037994:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+27:3663:x1875415569334912:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.038001:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788535829.038015:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788535829.038028:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+26:3663:x1875415569335296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535829.038035:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535829.038040:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc147 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc140 expref: 26 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.038049:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc147 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc140 expref: 26 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.038058:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535829.038081:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+26:3663:x1875415569335296:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.038087:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788535829.038099:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788535829.038104:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+25:3660:x1875415569335040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535829.038111:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535829.038115:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1f6 expref: 25 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.038123:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc1f6 expref: 25 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.038131:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535829.038181:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+25:3660:x1875415569335040:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.038187:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788535829.038198:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788535829.038203:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569335168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535829.038210:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535829.038221:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc194 expref: 24 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.038228:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc194 expref: 24 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535829.038237:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535829.038259:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569335168:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.038265:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788535829.038327:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569335168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535829.038336:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569335040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535829.038361:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569335296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535829.038368:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569334912:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535829.038726:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535829.039033:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461400/0xe79af2f39bbdc323 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc31c expref: 23 pid: 6529 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.039060:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334400:0@lo:104: 00010000:00010000:3.0:1788535829.039075:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdc1fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc1f6 expref: 22 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.039083:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334528:0@lo:104: 00010000:00010000:3.0:1788535829.039093:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc19b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc194 expref: 21 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.039101:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334656:0@lo:104: 00010000:00010000:3.0:1788535829.039110:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc147 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc140 expref: 20 pid: 6528 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.039118:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334784:0@lo:104: 00010000:00010000:1.0:1788535829.040015:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535829.045191:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535829.045284:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548304512 00000100:00100000:2.0:1788535829.045294:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548304512 00010000:00010000:2.0:1788535829.045332:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165522f expref: 10 pid: 6528 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535829.045372:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788535829.045506:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548304512:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535829.045687:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535829.045694:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165522f expref: 10 pid: 6528 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045708:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165522f expref: 10 pid: 6528 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045730:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045739:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045754:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045773:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045780:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045786:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045792:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788535829.045796:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045804:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045813:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535829.045823:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535829.045878:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548304512:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 497us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535829.045958:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00010000:00010000:3.0:1788535829.047490:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc43b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165522f expref: 9 pid: 6528 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535829.047510:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10408:1875415569334272:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535829.047711:0:10408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.047770:0:10408:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.047778:0:10408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535829.047784:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50400/0xe79af2f39bbdc4ff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535829.420636:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569335424:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.420711:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535829.420736:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569335808:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.420765:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569335936:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.420793:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.420825:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569336448:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.420848:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.420857:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535829.420879:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569336320:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.420886:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569336960:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.420916:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.420927:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569335552:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.420954:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569336832:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.420970:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535829.420987:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.420997:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569336064:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421033:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.421053:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569336576:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421074:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.421093:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788535829.421099:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569335680:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421120:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.421138:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569336192:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421182:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.421198:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569336704:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421216:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.421241:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569335424 00000100:00100000:1.0:1788535829.421248:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569335424 00000100:00100000:0.0:1788535829.421285:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569335936 00000100:00100000:0.0:1788535829.421292:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569335936 00000100:00100000:1.0:1788535829.421296:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788535829.421307:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:3663:x1875415569335424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.421320:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569335680 00000100:00100000:0.0:1788535829.421324:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569335680 00000100:00100000:0.0:1788535829.421345:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788535829.421357:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569335936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421359:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:3663:x1875415569335424:12345-0@lo:400:kworker.0 Request processed in 50us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.421371:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788535829.421411:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569336448 00000100:00100000:1.0:1788535829.421415:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569336448 00000100:00100000:0.0:1788535829.421417:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569335936:12345-0@lo:400:kworker.0 Request processed in 64us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.421428:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788535829.421446:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788535829.421455:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569335680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421456:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569336320 00000100:00100000:1.0:1788535829.421462:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569336320 00000100:00100000:1.0:1788535829.421493:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569336832 00000100:00100000:1.0:1788535829.421497:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569336832 00000100:00100000:1.0:1788535829.421511:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788535829.421518:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569336448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421669:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569336448:12345-0@lo:400:kworker.0 Request processed in 150us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.421677:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788535829.421689:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569335680:12345-0@lo:400:kworker.0 Request processed in 234us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.421697:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788535829.421701:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788535829.421708:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569336320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.421726:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569335808 00000100:00100000:0.0:1788535829.421731:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569335808 00000100:00100000:1.0:1788535829.421750:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569336320:12345-0@lo:400:kworker.0 Request processed in 45us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.421757:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788535829.421770:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788535829.421776:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569336832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421805:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569336832:12345-0@lo:400:kworker.0 Request processed in 28us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.421812:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788535829.421815:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569335552 00000100:00100000:0.0:1788535829.421820:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569335552 00000100:00100000:0.0:1788535829.421836:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569336064 00000100:00100000:0.0:1788535829.421838:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569336064 00000100:00100000:0.0:1788535829.421853:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569336576 00000100:00100000:0.0:1788535829.421858:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569336576 00000100:00100000:1.0:1788535829.421859:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535829.421878:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569336192 00000100:00100000:0.0:1788535829.421882:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569336192 00000100:00100000:0.0:1788535829.421897:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569336704 00000100:00100000:0.0:1788535829.421900:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569336704 00000100:00100000:1.0:1788535829.421901:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569335424:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421919:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569335936:0@lo:400:kworker.0 00010000:00080000:1.0:1788535829.421932:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb32d80 x1875415569336448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535829.421941:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569336448:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.421967:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569336960 00000100:00100000:1.0:1788535829.421970:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569336960 00000100:00100000:0.0:1788535829.421982:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788535829.421995:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569335808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.422000:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788535829.422009:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569336960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.422042:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569336960:12345-0@lo:400:kworker.0 Request processed in 35us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.422055:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788535829.422082:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb79880 x1875415569336960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535829.422092:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569336960:0@lo:400:kworker.0 00000100:00080000:1.0:1788535829.422117:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535829.422123:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535829.422126:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535829.422129:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535829.422167:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569335808:12345-0@lo:400:kworker.0 Request processed in 153us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.422175:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569335680:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.422177:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788535829.422200:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788535829.422208:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569335552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.422220:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569335808:0@lo:400:kworker.0 00010000:00080000:1.0:1788535829.422235:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb30700 x1875415569336320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535829.422244:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569336320:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.422250:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569335552:12345-0@lo:400:kworker.0 Request processed in 42us (1280us total) trans 0 rc 0/0 00010000:00080000:1.0:1788535829.422260:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7a300 x1875415569336832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535829.422268:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788535829.422277:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569336832:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.422291:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788535829.422299:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569336064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.422323:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569335552:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.422338:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569336064:12345-0@lo:400:kworker.0 Request processed in 39us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.422342:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569336064:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.422350:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788535829.422369:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788535829.422377:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569336576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.422391:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788535829.422402:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569336192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.422436:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569336576:12345-0@lo:400:kworker.0 Request processed in 60us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.422443:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788535829.422449:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569336192:12345-0@lo:400:kworker.0 Request processed in 48us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.422458:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788535829.422468:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569336704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.422481:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788535829.422532:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb33b80 x1875415569336192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535829.422543:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569336192:0@lo:400:kworker.0 00000100:00100000:1.0:1788535829.422553:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569336576:0@lo:400:kworker.0 00000100:00100000:0.0:1788535829.422730:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569336704:12345-0@lo:400:kworker.0 Request processed in 263us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535829.422737:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788535829.422834:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7ad80 x1875415569336704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535829.422844:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569336704:0@lo:400:kworker.0 00010000:00010000:3.0:1788535829.679578:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535829.932331:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569337088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535829.932400:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535829.932446:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569337088 00000100:00100000:3.0:1788535829.932454:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569337088 00000100:00100000:3.0:1788535829.932567:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788535829.932577:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569337088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535829.932614:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535829.932665:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569337088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535829.932672:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788535829.932771:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569337216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535829.932805:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535829.936266:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569337216 00000100:00100000:1.0:1788535829.936279:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569337216 00000100:00100000:1.0:1788535829.937110:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788535829.937122:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569337216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788535829.937164:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535829.937248:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569337216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (4441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535829.937256:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788535829.937711:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7d180 x1875415569337216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535829.937731:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569337216:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788535829.938752:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e560380 x1875415569337088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535829.938778:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569337088:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788535830.444329:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788535830.444336:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900485fef800 from 4 10000000:01000000:1.0:1788535830.444341:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788535830.444381:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.444392:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.444403:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535830.444439:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569337344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.444510:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.444565:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17000 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.444625:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569337344 00000100:00100000:2.0:1788535830.444634:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569337344 00000100:00100000:2.0:1788535830.444690:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788535830.444699:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569337344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535830.444726:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535830.444739:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc506 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.444768:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc506 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.444780:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc506 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.444789:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461000, rc 0) 00000100:00100000:2.0:1788535830.444828:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569337344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.444834:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788535830.445346:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569337344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535830.445363:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.445372:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535830.445436:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569337472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.445478:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.445509:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17000 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.445557:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569337472 00000100:00100000:2.0:1788535830.445562:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569337472 00000100:00100000:2.0:1788535830.445596:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788535830.445603:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569337472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535830.445720:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569337472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.445726:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788535830.445865:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569337472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.445891:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569337600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.445930:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.445951:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17000 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.446060:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569337600 00000100:00100000:2.0:1788535830.446065:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569337600 00000100:00100000:2.0:1788535830.446654:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788535830.446666:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569337600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535830.446782:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569337600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.446789:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788535830.447673:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569337600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.447919:0:10482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10482:1875415569337728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535830.447972:0:10482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.452694:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569337728 00000100:00100000:1.0:1788535830.452710:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569337728 00000100:00100000:0.0:1788535830.452830:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788535830.452839:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:10482:x1875415569337728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535830.453059:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:10482:x1875415569337728:12345-0@lo:502:llog_process_th.0 Request processed in 154us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535830.453068:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788535830.454260:0:10482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.454291:0:10482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10482:1875415569337728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535830.454332:0:10482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535830.454342:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535830.454345:0:10482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788535830.454352:0:10482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff900485fef800 00000020:00000080:2.0:1788535830.454355:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788535830.454428:0:10482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10482:1875415569337856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535830.454500:0:10482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535830.454531:0:10482:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535830.454658:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569337856 00000100:00100000:3.0:1788535830.454666:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569337856 00000100:00100000:3.0:1788535830.454709:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788535830.454718:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:10482:x1875415569337856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535830.456269:0:10482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10482:1875415569337856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535830.456309:0:10482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535830.456317:0:10482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535830.456319:0:10482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788535830.456323:0:10482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:3.0:1788535830.456701:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:10482:x1875415569337856:12345-0@lo:502:llog_process_th.0 Request processed in 1080us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535830.456712:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000020:01000000:3.0:1788535830.456759:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788535830.456783:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535830.456808:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535830.456819:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535830.456829:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788535830.456831:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005893a3800 from 4 10000000:01000000:3.0:1788535830.456834:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788535830.456868:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535830.456876:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535830.456885:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535830.456903:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569337984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.456952:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535830.456996:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.457561:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569337984 00000100:00100000:2.0:1788535830.457569:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569337984 00000100:00100000:2.0:1788535830.457649:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788535830.457658:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569337984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535830.457669:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535830.457682:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc514 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.457705:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc514 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.457717:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc514 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.457726:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461200, rc 0) 00000100:00100000:2.0:1788535830.457772:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569337984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.457785:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788535830.461824:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569337984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535830.461855:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535830.461867:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535830.461955:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.462021:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535830.462057:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535830.462076:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569338112 00000100:00100000:3.0:1788535830.462081:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569338112 00000100:00100000:3.0:1788535830.462118:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788535830.462126:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569338112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.462247:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569338112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535830.462255:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788535830.462288:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.462378:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.462414:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535830.462433:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535830.462445:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569338240 00000100:00100000:3.0:1788535830.462448:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569338240 00000100:00100000:3.0:1788535830.462660:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788535830.462670:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569338240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.462742:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569338240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535830.462749:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788535830.462786:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.462980:0:10486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10486:1875415569338368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535830.463075:0:10486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535830.463093:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569338368 00000100:00100000:3.0:1788535830.463101:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569338368 00000100:00100000:3.0:1788535830.463120:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788535830.463125:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:10486:x1875415569338368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535830.463203:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:10486:x1875415569338368:12345-0@lo:502:llog_process_th.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535830.463209:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788535830.463241:0:10486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535830.463251:0:10486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10486:1875415569338368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535830.463271:0:10486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535830.463279:0:10486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535830.463282:0:10486:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788535830.463289:0:10486:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9005893a3800 00000020:00000080:3.0:1788535830.463291:0:10486:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788535830.464369:0:10486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10486:1875415569338496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535830.464428:0:10486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535830.464459:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569338496 00000100:00100000:3.0:1788535830.464475:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569338496 00000100:00100000:3.0:1788535830.464507:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788535830.464615:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:10486:x1875415569338496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535830.464832:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:10486:x1875415569338496:12345-0@lo:502:llog_process_th.0 Request processed in 318us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535830.464839:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788535830.464880:0:10486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535830.464897:0:10486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10486:1875415569338496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535830.464919:0:10486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535830.464925:0:10486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535830.464931:0:10486:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788535830.464935:0:10486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788535830.464992:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788535830.465084:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535830.465093:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535830.465105:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535830.465115:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788535830.465118:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831a8000 from 4 10000000:01000000:3.0:1788535830.465121:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788535830.465162:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535830.465170:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535830.465179:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535830.465194:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.465222:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535830.465482:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.465496:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569338624 00000100:00100000:2.0:1788535830.465502:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569338624 00000100:00100000:2.0:1788535830.465529:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788535830.465536:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569338624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535830.465546:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535830.465557:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc522 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.465580:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc522 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.465591:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc522 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.465600:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461800, rc 0) 00000100:00100000:2.0:1788535830.465634:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569338624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.465640:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788535830.465788:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535830.465801:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535830.465810:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535830.465867:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.465893:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535830.468849:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.474598:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569338752 00000100:00100000:2.0:1788535830.474613:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569338752 00000100:00100000:2.0:1788535830.474701:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788535830.474711:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569338752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535830.474867:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569338752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (8972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.474874:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788535830.474924:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535830.474983:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535830.475029:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535830.475056:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.475069:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569338880 00000100:00100000:2.0:1788535830.475073:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569338880 00000100:00100000:2.0:1788535830.475093:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788535830.475099:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569338880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535830.475284:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569338880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.475290:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788535830.477752:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569338880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535830.478098:0:10489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10489:1875415569339008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535830.478442:0:10489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535830.478492:0:10489:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788535830.478533:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569339008 00000100:00100000:0.0:1788535830.478539:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569339008 00000100:00100000:0.0:1788535830.478580:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788535830.478588:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:10489:x1875415569339008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535830.478689:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:10489:x1875415569339008:12345-0@lo:502:llog_process_th.0 Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535830.478697:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788535830.478771:0:10489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10489:1875415569339008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535830.478793:0:10489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535830.478801:0:10489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535830.478804:0:10489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788535830.478811:0:10489:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9005831a8000 00000020:00000080:2.0:1788535830.478814:0:10489:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788535830.478918:0:10489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10489:1875415569339136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535830.478949:0:10489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535830.478967:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569339136 00000100:00100000:2.0:1788535830.478971:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569339136 00000100:00100000:2.0:1788535830.478993:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788535830.478999:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:10489:x1875415569339136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535830.479069:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:10489:x1875415569339136:12345-0@lo:502:llog_process_th.0 Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.479076:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788535830.479101:0:10489:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.479112:0:10489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10489:1875415569339136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535830.479129:0:10489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535830.479133:0:10489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535830.479162:0:10489:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788535830.479167:0:10489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788535830.480184:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788535830.480210:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788535830.480219:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.480228:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535830.480243:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788535830.480245:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831fb800 from 4 10000000:01000000:1.0:1788535830.480247:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788535830.480275:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.480283:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.480292:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535830.480310:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569339264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.480352:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.480374:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535830.480390:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569339264 00000100:00100000:1.0:1788535830.480395:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569339264 00000100:00100000:1.0:1788535830.480425:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788535830.480432:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569339264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535830.480442:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535830.480453:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc530 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.480494:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc530 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.480505:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc530 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.480525:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e440400, rc 0) 00000100:00100000:1.0:1788535830.480555:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569339264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535830.480562:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788535830.480596:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569339264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535830.480609:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.480619:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535830.480664:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569339392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.480685:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.480698:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535830.480708:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569339392 00000100:00100000:1.0:1788535830.480711:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569339392 00000100:00100000:1.0:1788535830.480730:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788535830.480737:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569339392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.480824:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569339392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535830.480831:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788535830.480859:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569339392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.480882:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569339520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.480914:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.480932:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535830.480942:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569339520 00000100:00100000:1.0:1788535830.480945:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569339520 00000100:00100000:1.0:1788535830.480963:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788535830.480969:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569339520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535830.481035:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569339520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535830.481041:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788535830.481073:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569339520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535830.488281:0:10490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10490:1875415569339648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535830.488360:0:10490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535830.495787:0:10490:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788535830.498113:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569339648 00000100:00100000:1.0:1788535830.498125:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569339648 00000100:00100000:1.0:1788535830.498212:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788535830.498222:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:10490:x1875415569339648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535830.498385:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:10490:x1875415569339648:12345-0@lo:502:llog_process_th.0 Request processed in 164us (10025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535830.498392:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788535830.501370:0:10490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10490:1875415569339648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535830.501416:0:10490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535830.501427:0:10490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535830.501429:0:10490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788535830.501437:0:10490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9005831fb800 00000020:00000080:3.0:1788535830.501440:0:10490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788535830.501516:0:10490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10490:1875415569339776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535830.501584:0:10490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535830.501618:0:10490:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535830.501772:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569339776 00000100:00100000:2.0:1788535830.501779:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569339776 00000100:00100000:2.0:1788535830.501830:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788535830.501840:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:10490:x1875415569339776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535830.501942:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:10490:x1875415569339776:12345-0@lo:502:llog_process_th.0 Request processed in 103us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.501950:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788535830.502235:0:10490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:10490:1875415569339776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535830.502254:0:10490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535830.502259:0:10490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535830.502261:0:10490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788535830.502265:0:10490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788535830.502622:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788535830.502644:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788535830.502654:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.502665:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535830.707045:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535830.913375:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535830.913580:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548304640 00000100:00100000:1.0:1788535830.913593:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548304640 00000100:00100000:2.0:1788535830.914474:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:2.0:1788535830.914487:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+9:6172:x1875415548304640:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535830.914506:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535830.914527:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655275 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.914564:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655275 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.914596:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655275 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535830.914605:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460a00, rc 0) 00000100:00100000:2.0:1788535830.914850:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6172:x1875415548304640:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 365us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.914858:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:0.0:1788535830.923115:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535830.923470:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548304768 00000100:00100000:3.0:1788535830.923481:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548304768 00000100:00100000:3.0:1788535830.923548:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:3.0:1788535830.923557:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6172:x1875415548304768:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535830.923829:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6172:x1875415548304768:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 272us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535830.923838:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:2.0:1788535830.931597:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535830.931676:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548304896 00000100:00100000:0.0:1788535830.931686:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548304896 00000100:00100000:0.0:1788535830.931744:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:0.0:1788535830.931754:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6172:x1875415548304896:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535830.931901:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6172:x1875415548304896:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 147us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535830.931909:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:0.0:1788535830.934570:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535830.934661:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548305024 00000100:00100000:2.0:1788535830.934671:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548305024 00000100:00100000:2.0:1788535830.934762:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 274 00000100:00100000:2.0:1788535830.934773:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6762:x1875415548305024:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788535830.936550:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6762:x1875415548305024:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 1770us (1979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535830.936564:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 274 00000100:00100000:1.0:1788535830.938585:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535830.952539:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548305152 00000100:00100000:0.0:1788535830.952557:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548305152 00000100:00100000:0.0:1788535830.952853:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:0.0:1788535830.952875:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6762:x1875415548305152:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788535830.953041:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:6762:x1875415548305152:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 177us (14477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535830.953048:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:1.0:1788535830.956882:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535830.956904:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569339904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535830.956964:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.957022:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569339904 00000100:00100000:1.0:1788535830.957038:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569339904 00000100:00100000:1.0:1788535830.957079:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788535830.957088:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569339904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535830.957115:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535830.957176:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569339904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535830.957186:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788535830.957222:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb32a00 x1875415569339904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535830.957235:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569339904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535830.960266:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535830.960289:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569340032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535830.960359:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535830.960620:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569340032 00000100:00100000:1.0:1788535830.960627:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569340032 00000100:00100000:1.0:1788535830.960674:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788535830.960684:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569340032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788535830.960704:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535830.960754:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569340032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535830.960760:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788535830.960903:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7d180 x1875415569340032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535830.960923:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569340032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535831.470222:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788535831.470245:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569340160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535831.470312:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535831.470552:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569340160 00000100:00100000:2.0:1788535831.470561:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569340160 00000100:00100000:2.0:1788535831.470613:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788535831.470623:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569340160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788535831.470655:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788535831.470709:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569340160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535831.470716:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788535831.470816:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569340160:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788535831.724407:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535831.981832:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569340288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788535831.981900:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535831.982046:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569340288 00000100:00100000:2.0:1788535831.982054:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569340288 00000100:00100000:2.0:1788535831.982122:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788535831.982130:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569340288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788535831.982290:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788535831.982348:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569340288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 218us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535831.982356:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788535831.982624:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569340288:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788535832.749757:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535833.773320:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535833.979084:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535833.979126:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535833.979179:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535833.979206:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535833.979232:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535833.979258:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548305408 00000100:00100000:1.0:1788535833.979268:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548305408 00000100:00100000:1.0:1788535833.979323:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548305536 00000100:00100000:1.0:1788535833.979326:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548305536 00000100:00100000:1.0:1788535833.979344:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1788535833.979353:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2400:x1875415548305408:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535833.979420:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2400:x1875415548305408:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535833.979427:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1788535833.979454:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:1.0:1788535833.979461:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548305536:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535833.979491:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548305536:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535833.979497:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:1.0:1788535833.979513:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548305664 00000100:00100000:1.0:1788535833.979516:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548305664 00000100:00100000:1.0:1788535833.979537:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548305792 00000100:00100000:1.0:1788535833.979539:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548305792 00000100:00100000:1.0:1788535833.979554:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788535833.979560:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548305664:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535833.979580:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548305664:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 20us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535833.979597:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788535833.979609:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1788535833.979615:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005c191e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548305792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535833.979636:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005c191e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548305792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535833.979642:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00080000:1.0:1788535833.979784:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535833.979788:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535833.979790:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535833.979792:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535833.980073:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548305280 00000100:00100000:0.0:1788535833.980078:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548305280 00000100:00100000:0.0:1788535833.980119:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:0.0:1788535833.980128:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2400:x1875415548305280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535833.980181:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2400:x1875415548305280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 54us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535833.980187:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:0.0:1788535834.543607:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569340544:0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.543675:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.543727:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569341056:0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.543751:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.543774:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569341568:0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.543794:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.543818:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788535834.543823:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569340416:0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.543848:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.543868:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569340928:0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.543889:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.543906:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569341440:0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.543929:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.543945:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569341952:0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.543964:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535834.543995:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569340544 00000100:00100000:0.0:1788535834.544002:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569340544 00000100:00100000:0.0:1788535834.544044:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569341056 00000100:00100000:0.0:1788535834.544048:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569341056 00000100:00100000:0.0:1788535834.544073:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569341568 00000100:00100000:0.0:1788535834.544076:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569341568 00000100:00100000:0.0:1788535834.544094:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788535834.544103:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569340544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535834.544244:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569340800:0@lo:400:kworker.0 00000100:00100000:1.0:1788535834.545548:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569340672:0@lo:400:kworker.0 00000100:00100000:3.0:1788535834.547296:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535834.547401:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569341312:0@lo:400:kworker.0 00000100:00100000:3.0:1788535834.547431:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535834.547468:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569341824:0@lo:400:kworker.0 00000100:00100000:3.0:1788535834.547488:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535834.548284:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569340416 00000100:00100000:3.0:1788535834.548295:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569340416 00000100:00100000:3.0:1788535834.548411:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788535834.548420:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569340416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535834.548491:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569340416:12345-0@lo:400:kworker.0 Request processed in 72us (4641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535834.548498:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788535834.548608:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569340544:12345-0@lo:400:kworker.0 Request processed in 4504us (4930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.548617:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788535834.548638:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569340800 00000100:00100000:0.0:1788535834.548642:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569340800 00000100:00100000:0.0:1788535834.548660:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788535834.548676:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569341056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.548710:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569341056:12345-0@lo:400:kworker.0 Request processed in 36us (4958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.548715:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788535834.548727:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788535834.548733:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569341568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.548757:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569341568:12345-0@lo:400:kworker.0 Request processed in 26us (4963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.548763:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788535834.548772:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788535834.548777:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569340800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.548807:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569340800:12345-0@lo:400:kworker.0 Request processed in 30us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.548813:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788535834.548840:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569340928 00000100:00100000:0.0:1788535834.548844:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569340928 00000100:00100000:0.0:1788535834.548870:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788535834.548876:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569340928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.548908:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569340928:12345-0@lo:400:kworker.0 Request processed in 32us (5018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.548915:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788535834.548933:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569341440 00000100:00100000:0.0:1788535834.548936:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569341440 00000100:00100000:0.0:1788535834.548956:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569341952 00000100:00100000:0.0:1788535834.548959:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569341952 00000100:00100000:0.0:1788535834.548969:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569341312 00000100:00100000:0.0:1788535834.548972:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569341312 00000100:00100000:0.0:1788535834.548991:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569341824 00000100:00100000:0.0:1788535834.548994:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569341824 00000100:00100000:0.0:1788535834.549005:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788535834.549010:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569341440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.549039:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569341440:12345-0@lo:400:kworker.0 Request processed in 29us (5109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.549044:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788535834.549053:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788535834.549058:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569341952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.549079:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569341952:12345-0@lo:400:kworker.0 Request processed in 21us (5115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.549084:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788535834.549092:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788535834.549097:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569341312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.549119:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569341312:12345-0@lo:400:kworker.0 Request processed in 22us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.549125:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788535834.549134:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788535834.549139:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569341824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535834.549768:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535834.549799:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569341184:0@lo:400:kworker.0 00000100:00100000:1.0:1788535834.549826:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535834.549845:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569341696:0@lo:400:kworker.0 00000100:00100000:1.0:1788535834.549866:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788535834.549897:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535834.549901:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535834.549904:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535834.549937:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569340672 00000100:00100000:1.0:1788535834.549942:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569340672 00000100:00100000:1.0:1788535834.549966:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788535834.549971:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569340672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535834.550006:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569340672:12345-0@lo:400:kworker.0 Request processed in 34us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535834.550019:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788535834.550055:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569340672:0@lo:400:kworker.0 00000100:00100000:1.0:1788535834.550075:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569341184 00000100:00100000:1.0:1788535834.550077:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569341184 00000100:00100000:1.0:1788535834.550098:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569341696 00000100:00100000:1.0:1788535834.550101:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569341696 00000100:00100000:1.0:1788535834.550114:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788535834.550118:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569341184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535834.551480:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569341824:12345-0@lo:400:kworker.0 Request processed in 2335us (3986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535834.551490:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535834.552302:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788535834.552317:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569341696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.552365:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569341696:12345-0@lo:400:kworker.0 Request processed in 54us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535834.552371:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788535834.552420:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569340416:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.552451:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569340928:0@lo:400:kworker.0 00010000:00080000:2.0:1788535834.552466:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e560700 x1875415569341440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535834.552477:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569341440:0@lo:400:kworker.0 00010000:00080000:2.0:1788535834.552489:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e560380 x1875415569341952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535834.552498:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569341952:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.552510:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569340544:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.552644:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569341056:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.552661:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569341568:0@lo:400:kworker.0 00000100:00100000:2.0:1788535834.552719:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569340800:0@lo:400:kworker.0 00010000:00080000:2.0:1788535834.552732:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e563b80 x1875415569341312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535834.552740:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569341312:0@lo:400:kworker.0 00010000:00080000:2.0:1788535834.552750:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e562a00 x1875415569341824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535834.552757:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569341824:0@lo:400:kworker.0 00000100:00100000:1.0:1788535834.554527:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569341184:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535834.554545:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788535834.554583:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788535834.554643:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e563480 x1875415569341184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535834.554659:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569341184:0@lo:400:kworker.0 00010000:00080000:1.0:1788535834.554672:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e563100 x1875415569341696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535834.554681:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569341696:0@lo:400:kworker.0 00000001:02000400:3.0:1788535834.616729:0:10708:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788535834.803057:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535835.052345:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569342080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535835.052419:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535835.052537:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569342080 00000100:00100000:1.0:1788535835.052544:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569342080 00000100:00100000:1.0:1788535835.053285:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788535835.053295:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569342080:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788535835.053309:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535835.053324:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569342208:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535835.053339:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535835.053393:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569342080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535835.053400:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788535835.053447:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb78e00 x1875415569342080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535835.053466:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569342080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788535835.053946:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535835.054103:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569342208 00000100:00100000:1.0:1788535835.054110:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569342208 00000100:00100000:1.0:1788535835.054171:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788535835.054181:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569342208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535835.054195:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535835.054238:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569342208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535835.054244:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788535835.055758:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e563100 x1875415569342208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535835.055782:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569342208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788535835.820377:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535836.077248:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569342336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535836.077311:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535836.077378:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569342336 00000100:00100000:1.0:1788535836.077385:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569342336 00000100:00100000:1.0:1788535836.077441:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788535836.077450:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569342336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535836.077477:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535836.077518:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569342336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535836.077525:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788535836.077551:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535836.077579:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb78a80 x1875415569342336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535836.077597:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569342336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535836.078005:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535836.078016:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569342464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788535836.078045:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535836.078070:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569342464 00000100:00100000:1.0:1788535836.078074:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569342464 00000100:00100000:1.0:1788535836.078101:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788535836.078107:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569342464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788535836.078118:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535836.078172:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569342464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535836.078178:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788535836.078194:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535836.078210:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb31500 x1875415569342464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535836.078224:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569342464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535836.588384:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535836.588407:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569342592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535836.588485:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535836.588648:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569342592 00000100:00100000:2.0:1788535836.588657:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569342592 00000100:00100000:2.0:1788535836.588706:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788535836.588713:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569342592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788535836.588756:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788535836.588806:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569342592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535836.588813:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788535836.588896:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569342592:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535836.851759:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535837.100466:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569342720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535837.100544:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535837.100728:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569342720 00000100:00100000:0.0:1788535837.100737:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569342720 00000100:00100000:0.0:1788535837.100789:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788535837.100799:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569342720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788535837.100835:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788535837.100886:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569342720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535837.100893:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788535837.100940:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569342720:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788535837.873688:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788535838.742605:0:10952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing yml_node 00010000:00010000:1.0:1788535838.899928:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535839.105251:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535839.105295:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535839.105334:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535839.105356:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535839.105384:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535839.105397:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548305920 00000100:00100000:0.0:1788535839.105418:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548305920 00000100:00100000:1.0:1788535839.105425:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548306176 00000100:00100000:1.0:1788535839.105431:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548306176 00000100:00100000:0.0:1788535839.105483:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:1.0:1788535839.105484:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548306048 00000100:00100000:1.0:1788535839.105489:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548306048 00000100:00100000:0.0:1788535839.105497:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2402:x1875415548305920:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535839.105516:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:1.0:1788535839.105538:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548306176:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535839.105576:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2402:x1875415548305920:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535839.105578:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548306176:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.105592:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:1.0:1788535839.105593:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:1.0:1788535839.105613:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1788535839.105620:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548306048:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535839.105643:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548306048:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535839.105650:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1788535839.105680:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548306304 00000100:00100000:1.0:1788535839.105683:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548306304 00000100:00100000:1.0:1788535839.105705:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548306432 00000100:00100000:1.0:1788535839.105708:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548306432 00000100:00100000:1.0:1788535839.105738:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1788535839.105747:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2398:x1875415548306304:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1788535839.105771:0:8448:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc450 00000100:00080000:1.0:1788535839.105780:0:8448:0:(import.c:65:import_set_state_nolock()) ffff90059e52e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788535839.105825:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788535839.105932:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+2:2398:x1875415548306304:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 187us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535839.105946:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1788535839.106020:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1788535839.106028:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2398:x1875415548306432:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1788535839.106040:0:8448:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc457 00000100:00080000:1.0:1788535839.106046:0:8448:0:(import.c:65:import_set_state_nolock()) ffff900485d02000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788535839.106072:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788535839.106142:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+2:2398:x1875415548306432:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 114us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535839.106166:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00080000:1.0:1788535839.106191:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788535839.106193:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788535839.106195:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535839.106199:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535839.106202:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788535839.106385:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535839.661934:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569342848:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.661934:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569343232:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.662484:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.662533:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569343744:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.662561:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.662593:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569344256:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.662617:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.662733:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569342976:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.662840:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.662865:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569343488:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.662891:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.662909:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569344000:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.662933:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.662952:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788535839.662958:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569343104:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.662985:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.663005:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569343616:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.663026:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.663044:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569344128:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.663064:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535839.663091:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569343232 00000100:00100000:0.0:1788535839.663098:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569343232 00000100:00100000:0.0:1788535839.663168:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569342976 00000100:00100000:0.0:1788535839.663173:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569342976 00000100:00100000:0.0:1788535839.663187:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569343488 00000100:00100000:0.0:1788535839.663189:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569343488 00000100:00100000:0.0:1788535839.663211:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569344000 00000100:00100000:0.0:1788535839.663213:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569344000 00000100:00100000:0.0:1788535839.663242:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569343616 00000100:00100000:0.0:1788535839.663244:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569343616 00000100:00100000:0.0:1788535839.663258:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569344128 00000100:00100000:0.0:1788535839.663261:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569344128 00000100:00100000:0.0:1788535839.664915:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788535839.664929:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569343232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.665005:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569343232:12345-0@lo:400:kworker.0 Request processed in 80us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.665022:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788535839.665039:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788535839.665046:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569342976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.665081:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569342976:12345-0@lo:400:kworker.0 Request processed in 36us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.665089:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788535839.665103:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788535839.665111:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569343488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.665139:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569343488:12345-0@lo:400:kworker.0 Request processed in 30us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.665162:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788535839.665178:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788535839.665186:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569344000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.665220:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569344000:12345-0@lo:400:kworker.0 Request processed in 35us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.665226:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788535839.665239:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788535839.665245:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569343616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.671483:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535839.671692:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569343360:0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.671736:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535839.671762:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569343872:0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.671794:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535839.671820:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569344384:0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.671853:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535839.671914:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569343104 00000100:00100000:3.0:1788535839.671924:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569343104 00000100:00100000:3.0:1788535839.671966:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569343360 00000100:00100000:3.0:1788535839.671970:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569343360 00000100:00100000:3.0:1788535839.671990:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788535839.671999:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569343104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.672059:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569343104:12345-0@lo:400:kworker.0 Request processed in 60us (9072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535839.672068:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788535839.672090:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788535839.672097:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569343360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.672132:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569343360:12345-0@lo:400:kworker.0 Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535839.672139:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788535839.672180:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569343744 00000100:00100000:3.0:1788535839.672185:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569343744 00000100:00100000:3.0:1788535839.672214:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569344256 00000100:00100000:3.0:1788535839.672217:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569344256 00000100:00100000:3.0:1788535839.672237:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569343872 00000100:00100000:3.0:1788535839.672239:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569343872 00000100:00100000:3.0:1788535839.672255:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569344384 00000100:00100000:3.0:1788535839.672257:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569344384 00000100:00100000:3.0:1788535839.672269:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788535839.672277:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569343744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.672321:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569343744:12345-0@lo:400:kworker.0 Request processed in 44us (9758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535839.672328:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788535839.672354:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788535839.672361:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569344256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.672397:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569344256:12345-0@lo:400:kworker.0 Request processed in 38us (9780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535839.672414:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788535839.672424:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788535839.672429:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569343872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.672450:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569343872:12345-0@lo:400:kworker.0 Request processed in 22us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535839.672456:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788535839.672466:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788535839.672472:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569344384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.672500:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569344384:12345-0@lo:400:kworker.0 Request processed in 28us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.672890:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569343616:12345-0@lo:400:kworker.0 Request processed in 7642us (9860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.672902:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788535839.672923:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788535839.672933:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569344128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.672969:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569344128:12345-0@lo:400:kworker.0 Request processed in 41us (9905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535839.672982:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788535839.673034:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535839.673038:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535839.673041:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788535839.673043:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535839.674460:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569343232:0@lo:400:kworker.0 00010000:00080000:0.0:1788535839.674482:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488085f80 x1875415569343744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535839.674495:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569343744:0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.674508:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569342848 00010000:00080000:0.0:1788535839.674511:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488084000 x1875415569344256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535839.674518:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569342848 00000100:00100000:0.0:1788535839.674523:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569344256:0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.674566:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788535839.674575:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569342848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.674580:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569343104:0@lo:400:kworker.0 00010000:00080000:0.0:1788535839.674597:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488085880 x1875415569343616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535839.674607:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569343616:0@lo:400:kworker.0 00010000:00080000:0.0:1788535839.674619:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488084e00 x1875415569344128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535839.674628:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569344128:0@lo:400:kworker.0 00000100:00100000:2.0:1788535839.674661:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569342848:12345-0@lo:400:kworker.0 Request processed in 86us (3186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535839.674678:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788535839.675107:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788535839.675184:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569342848:0@lo:400:kworker.0 00000100:00100000:3.0:1788535839.675197:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569343360:0@lo:400:kworker.0 00010000:00080000:3.0:1788535839.675210:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488084380 x1875415569343872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535839.675219:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569343872:0@lo:400:kworker.0 00010000:00080000:3.0:1788535839.675230:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488084a80 x1875415569344384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535839.675238:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569344384:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.676388:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569342976:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.677116:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569343488:0@lo:400:kworker.0 00000100:00100000:0.0:1788535839.677131:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569344000:0@lo:400:kworker.0 00010000:00010000:1.0:1788535839.917212:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535840.172414:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569344512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535840.172486:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535840.172647:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569344512 00000100:00100000:2.0:1788535840.172656:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569344512 00000100:00100000:2.0:1788535840.172708:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788535840.172718:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569344512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788535840.172746:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535840.172796:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569344512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535840.172803:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788535840.172910:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7a680 x1875415569344512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535840.172929:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569344512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535840.173284:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569344640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535840.173317:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535840.173558:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569344640 00000100:00100000:3.0:1788535840.173576:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569344640 00000100:00100000:3.0:1788535840.173613:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788535840.173621:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569344640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535840.173636:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535840.173683:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569344640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535840.173689:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788535840.173761:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488084e00 x1875415569344640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535840.173775:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569344640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788535840.947184:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535841.196564:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569344768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535841.196652:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535841.196926:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569344768 00000100:00100000:1.0:1788535841.196934:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569344768 00000100:00100000:1.0:1788535841.196997:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788535841.197007:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569344768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788535841.197035:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535841.197079:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569344768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535841.197086:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788535841.197537:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569344896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535841.197573:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535841.197877:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569344896 00000100:00100000:2.0:1788535841.197884:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569344896 00000100:00100000:2.0:1788535841.197924:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788535841.197931:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569344896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788535841.197943:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535841.197985:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569344896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535841.197991:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788535841.198205:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788535841.198241:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e756a00 x1875415569344768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535841.198260:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569344768:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788535841.198409:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb79500 x1875415569344896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535841.198422:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569344896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535841.708574:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535841.708615:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569345024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788535841.708690:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535841.708823:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569345024 00000100:00100000:3.0:1788535841.708832:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569345024 00000100:00100000:3.0:1788535841.708895:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788535841.708904:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569345024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788535841.708934:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535841.708983:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569345024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535841.708989:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788535841.709210:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569345024:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535841.965637:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535842.220359:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535842.220381:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569345152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788535842.220460:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535842.220521:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569345152 00000100:00100000:0.0:1788535842.220528:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569345152 00000100:00100000:0.0:1788535842.220572:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788535842.220581:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569345152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788535842.220613:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788535842.220668:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569345152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535842.220675:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788535842.220721:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569345152:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788535842.575229:0:11135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00010000:00010000:1.0:1788535842.988289:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535844.012358:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535844.223340:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535844.223425:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535844.223674:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535844.223705:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548306816 00000100:00100000:2.0:1788535844.223714:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548306816 00000100:00100000:2.0:1788535844.223772:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548306688 00000100:00100000:2.0:1788535844.223776:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548306688 00000100:00100000:2.0:1788535844.223800:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:2.0:1788535844.223819:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548306816:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535844.223891:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548306816:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535844.223898:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:2.0:1788535844.223916:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1788535844.223923:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548306688:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535844.223948:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548306688:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535844.223955:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00080000:2.0:1788535844.223972:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535844.223976:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535844.225854:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548306560 00000100:00100000:3.0:1788535844.225870:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548306560 00000100:00100000:2.0:1788535844.226061:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00100000:2.0:1788535844.226071:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548306560:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535844.226135:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548306560:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 66us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535844.226143:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00100000:1.0:1788535844.782360:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569345664:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782447:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782500:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569346176:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782532:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782554:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569346688:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782575:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782605:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788535844.782611:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569345536:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782637:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782652:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569346048:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782671:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782686:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569346560:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782704:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782742:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569345408:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782765:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782780:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569345920:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782799:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782813:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569346432:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782833:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782845:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788535844.782850:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569345280:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782876:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782910:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569345792:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782933:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782947:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569346304:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.782966:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.782984:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569346816:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783001:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535844.783028:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569345664 00000100:00100000:1.0:1788535844.783035:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569345664 00000100:00100000:1.0:1788535844.783069:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569346048 00000100:00100000:1.0:1788535844.783071:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569346048 00000100:00100000:1.0:1788535844.783089:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569346560 00000100:00100000:1.0:1788535844.783091:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569346560 00000100:00100000:1.0:1788535844.783100:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569345408 00000100:00100000:1.0:1788535844.783102:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569345408 00000100:00100000:1.0:1788535844.783110:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569345920 00000100:00100000:1.0:1788535844.783112:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569345920 00000100:00100000:1.0:1788535844.783121:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569346432 00000100:00100000:1.0:1788535844.783123:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569346432 00000100:00100000:1.0:1788535844.783135:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788535844.783167:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569345664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783217:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569345664:12345-0@lo:400:kworker.0 Request processed in 72us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783224:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788535844.783241:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788535844.783248:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569346048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783276:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569346048:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783281:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788535844.783304:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788535844.783310:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569346560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783336:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569346560:12345-0@lo:400:kworker.0 Request processed in 27us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783342:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788535844.783352:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788535844.783357:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569345408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783401:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569345408:12345-0@lo:400:kworker.0 Request processed in 44us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783407:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788535844.783417:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788535844.783423:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569345920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783448:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569345920:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783454:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788535844.783465:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788535844.783470:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569346432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783497:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569346432:12345-0@lo:400:kworker.0 Request processed in 27us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783503:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788535844.783520:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569346176 00000100:00100000:1.0:1788535844.783523:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569346176 00000100:00100000:1.0:1788535844.783540:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569346688 00000100:00100000:1.0:1788535844.783543:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569346688 00000100:00100000:1.0:1788535844.783553:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569346304 00000100:00100000:1.0:1788535844.783555:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569346304 00000100:00100000:1.0:1788535844.783565:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569346816 00000100:00100000:1.0:1788535844.783574:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569346816 00000100:00100000:1.0:1788535844.783590:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788535844.783597:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569346176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783626:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569346176:12345-0@lo:400:kworker.0 Request processed in 30us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783632:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788535844.783643:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788535844.783648:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569346688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783675:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569346688:12345-0@lo:400:kworker.0 Request processed in 27us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783680:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788535844.783690:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788535844.783696:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569346304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783719:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569346304:12345-0@lo:400:kworker.0 Request processed in 24us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783725:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788535844.783735:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788535844.783740:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569346816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783764:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569346816:12345-0@lo:400:kworker.0 Request processed in 24us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535844.783769:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788535844.783806:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487465880 x1875415569346304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535844.783820:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569346304:0@lo:400:kworker.0 00010000:00080000:1.0:1788535844.783831:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f0700 x1875415569346816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535844.783847:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569346816:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783860:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569345408:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783870:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569345920:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783879:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569346432:0@lo:400:kworker.0 00010000:00080000:1.0:1788535844.783915:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900485d93100 x1875415569346048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535844.783923:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569346048:0@lo:400:kworker.0 00010000:00080000:1.0:1788535844.783932:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f0e00 x1875415569346560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535844.783940:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569346560:0@lo:400:kworker.0 00000100:00100000:1.0:1788535844.783950:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569345664:0@lo:400:kworker.0 00010000:00080000:1.0:1788535844.783958:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900485d92a00 x1875415569346176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535844.783965:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569346176:0@lo:400:kworker.0 00010000:00080000:1.0:1788535844.783974:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f0000 x1875415569346688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535844.783981:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569346688:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.784194:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569345280 00000100:00100000:2.0:1788535844.784199:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569345280 00000100:00100000:2.0:1788535844.784237:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788535844.784244:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569345280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.784281:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569345280:12345-0@lo:400:kworker.0 Request processed in 39us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535844.784288:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:2.0:1788535844.784322:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535844.784326:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535844.784334:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535844.784336:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535844.784351:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569345280:0@lo:400:kworker.0 00000100:00100000:0.0:1788535844.787500:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569345536 00000100:00100000:0.0:1788535844.787514:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569345536 00000100:00100000:0.0:1788535844.787561:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569345792 00000100:00100000:0.0:1788535844.787564:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569345792 00000100:00100000:0.0:1788535844.787583:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788535844.787592:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569345536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535844.787696:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569345536:12345-0@lo:400:kworker.0 Request processed in 105us (5058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535844.787704:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788535844.787720:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788535844.787726:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569345792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535844.787761:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569345792:12345-0@lo:400:kworker.0 Request processed in 35us (4827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535844.787768:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788535844.787814:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569345536:0@lo:400:kworker.0 00000100:00100000:2.0:1788535844.788079:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569345792:0@lo:400:kworker.0 00000001:02000400:1.0:1788535844.788267:0:11232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00010000:00010000:1.0:1788535845.039117:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535845.295658:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569346944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535845.295719:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535845.295945:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569346944 00000100:00100000:0.0:1788535845.295952:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569346944 00000100:00100000:0.0:1788535845.296180:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788535845.296190:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569346944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535845.296216:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535845.296256:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569346944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535845.296271:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788535845.296526:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488085880 x1875415569346944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535845.296544:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569346944:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788535845.296641:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:3.0:1788535845.296645:0:9525:0:(genops.c:885:class_export_put()) final put ffff900485d06800/b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:0.0:1788535845.296729:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff900485d06800/b9ef506c-5095-4495-a34a-e3b5845d008a for lustre-OST0001 00000020:00000080:0.0:1788535845.302474:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900485d02000 for lustre-OST0001 00000100:00100000:0.0:1788535845.302508:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569347072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535845.302578:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1788535845.302947:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:0.0:1788535845.302952:0:8441:0:(genops.c:885:class_export_put()) final put ffff90059e52c000/b9ef506c-5095-4495-a34a-e3b5845d008a 00000100:00100000:3.0:1788535845.302999:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569347072 00000100:00100000:3.0:1788535845.303007:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569347072 00000020:00000080:2.0:1788535845.303112:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90059e52c000/b9ef506c-5095-4495-a34a-e3b5845d008a for lustre-OST0000 00000020:00000080:2.0:1788535845.303170:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90059e52e000 for lustre-OST0000 00000100:00100000:3.0:1788535845.303275:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788535845.303284:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569347072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535845.303310:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535845.303373:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569347072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535845.303380:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788535845.303491:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7bb80 x1875415569347072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535845.303509:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569347072:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788535846.062405:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535846.317498:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569347200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535846.317570:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535846.318016:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569347200 00000100:00100000:3.0:1788535846.318025:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569347200 00000100:00080000:2.0:1788535846.318187:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535846.318290:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788535846.318302:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569347200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535846.318331:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535846.318401:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569347200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535846.318408:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788535846.318479:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb78700 x1875415569347200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535846.318500:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569347200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535846.318750:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569347328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535846.318782:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535846.318932:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569347328 00000100:00100000:3.0:1788535846.318938:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569347328 00000100:00100000:3.0:1788535846.318990:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788535846.318998:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569347328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788535846.319009:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535846.319039:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569347328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535846.319046:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788535846.319140:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788535846.319180:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900485d91c00 x1875415569347328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535846.319194:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569347328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535846.828306:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569347456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535846.828387:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535846.830821:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569347456 00000100:00100000:1.0:1788535846.830834:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569347456 00000100:00100000:1.0:1788535846.830889:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788535846.830898:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569347456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788535846.830936:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788535846.831013:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569347456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535846.831021:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788535846.831123:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569347456:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788535847.052843:0:11330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00010000:00010000:0.0:1788535847.085822:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535847.342304:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569347584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788535847.342477:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535847.342675:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569347584 00000100:00100000:1.0:1788535847.342684:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569347584 00000100:00100000:1.0:1788535847.342737:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788535847.342747:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569347584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788535847.342780:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788535847.342850:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569347584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535847.342856:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788535847.343088:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569347584:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788535848.108548:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788535848.632027:0:11378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 11:30:47 EDT 2026 00010000:00010000:1.0:1788535849.132931:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535849.338028:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535849.338077:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535849.338113:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535849.338143:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548307072 00000100:00100000:2.0:1788535849.338192:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548307072 00000100:00100000:2.0:1788535849.338255:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548307200 00000100:00100000:2.0:1788535849.338259:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548307200 00000100:00100000:2.0:1788535849.338282:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:2.0:1788535849.338292:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548307072:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535849.338376:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548307072:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 85us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.338384:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:2.0:1788535849.338401:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:2.0:1788535849.338407:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548307200:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535849.338431:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548307200:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.338437:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00080000:2.0:1788535849.338477:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535849.338481:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535849.338642:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548306944 00000100:00100000:0.0:1788535849.338647:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548306944 00000100:00100000:0.0:1788535849.338685:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:0.0:1788535849.338694:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548306944:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535849.338739:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548306944:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 47us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.338745:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:3.0:1788535849.907281:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535849.907311:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569347712:0@lo:400:kworker.0 00000100:00100000:3.0:1788535849.907412:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535849.907810:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569347840:0@lo:400:kworker.0 00000100:00100000:1.0:1788535849.907843:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535849.908905:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569347712 00000100:00100000:0.0:1788535849.908918:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569347712 00000100:00100000:0.0:1788535849.908972:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788535849.908982:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3662:x1875415569347712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.909049:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3662:x1875415569347712:12345-0@lo:400:kworker.0 Request processed in 69us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.909057:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788535849.909091:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569347840 00000100:00100000:0.0:1788535849.909095:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569347840 00000100:00100000:0.0:1788535849.909125:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788535849.909132:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569347840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.909195:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569347840:12345-0@lo:400:kworker.0 Request processed in 63us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.909202:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788535849.909413:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569347712:0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.909559:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569347968:0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.909601:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535849.909630:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569347968 00000100:00100000:2.0:1788535849.909635:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569347968 00000100:00100000:0.0:1788535849.909648:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569348480:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.909668:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788535849.909679:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569347968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.909679:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535849.909705:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569348992:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.909724:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569347968:12345-0@lo:400:kworker.0 Request processed in 48us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.909731:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788535849.909737:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535849.909769:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569348480 00000100:00100000:2.0:1788535849.909773:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569348480 00000100:00100000:0.0:1788535849.909777:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569347968:0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.909794:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788535849.909801:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569348352:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.909805:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569348992 00000100:00100000:2.0:1788535849.909808:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569348992 00000100:00100000:2.0:1788535849.909830:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788535849.909831:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535849.909839:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569348480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.909855:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569348864:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.909885:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569348480:12345-0@lo:400:kworker.0 Request processed in 48us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.909894:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535849.909898:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788535849.909912:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569348352 00000100:00100000:2.0:1788535849.909915:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569348352 00010000:00080000:0.0:1788535849.909924:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7b800 x1875415569348480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535849.909929:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569348864 00000100:00100000:2.0:1788535849.909933:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569348864 00000100:00100000:0.0:1788535849.909938:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569348480:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.909949:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788535849.909956:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569348992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.909971:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788535849.909981:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569348352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.909988:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569348992:12345-0@lo:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.909995:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788535849.910008:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788535849.910016:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569348864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.910022:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569348352:12345-0@lo:400:kworker.0 Request processed in 43us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.910029:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788535849.910049:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569348864:12345-0@lo:400:kworker.0 Request processed in 34us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.910058:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788535849.910059:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569348096:0@lo:400:kworker.0 00000100:00080000:2.0:1788535849.910077:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535849.910082:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535849.910090:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535849.910110:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569348608:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.910111:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569348096 00000100:00100000:2.0:1788535849.910116:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569348096 00000100:00100000:2.0:1788535849.910139:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788535849.910175:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535849.910196:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569349120:0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.910217:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535849.910486:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788535849.910494:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569348224:0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.910531:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535849.910552:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569348736:0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.910580:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535849.910597:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569349248:0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.910681:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535849.910712:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569348608 00000100:00100000:0.0:1788535849.910716:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569348608 00000100:00100000:0.0:1788535849.910745:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569349120 00000100:00100000:0.0:1788535849.910748:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569349120 00000100:00100000:0.0:1788535849.910758:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569348736 00000100:00100000:0.0:1788535849.910760:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569348736 00000100:00100000:0.0:1788535849.910772:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569349248 00000100:00100000:0.0:1788535849.910774:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569349248 00000100:00100000:0.0:1788535849.910786:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788535849.910792:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569348608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.910829:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569348608:12345-0@lo:400:kworker.0 Request processed in 37us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.910835:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788535849.910847:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788535849.910853:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569349120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.910878:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569349120:12345-0@lo:400:kworker.0 Request processed in 25us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.910883:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788535849.910892:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788535849.910897:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569348736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.910920:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569348736:12345-0@lo:400:kworker.0 Request processed in 23us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.910925:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788535849.910934:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788535849.910945:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569349248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.910973:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569349248:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.910979:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788535849.911000:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569348224 00000100:00100000:0.0:1788535849.911004:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569348224 00000100:00100000:0.0:1788535849.911026:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788535849.911032:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569348224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.911061:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569348224:12345-0@lo:400:kworker.0 Request processed in 30us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535849.911067:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788535849.911088:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535849.911091:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535849.911116:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569348352:0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.911126:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569348864:0@lo:400:kworker.0 00010000:00080000:0.0:1788535849.911138:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7a300 x1875415569348992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535849.911346:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569347840:0@lo:400:kworker.0 00000100:00100000:1.0:1788535849.911394:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569348224:0@lo:400:kworker.0 00010000:00080000:1.0:1788535849.911529:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb79f80 x1875415569348736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535849.911542:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569348736:0@lo:400:kworker.0 00010000:00080000:1.0:1788535849.911555:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7bb80 x1875415569349248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535849.911573:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569349248:0@lo:400:kworker.0 00010000:00080000:1.0:1788535849.911587:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb78380 x1875415569348608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535849.911594:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569348608:0@lo:400:kworker.0 00010000:00080000:1.0:1788535849.911602:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb79880 x1875415569349120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535849.911609:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569349120:0@lo:400:kworker.0 00000100:00100000:0.0:1788535849.911698:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569348992:0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.911814:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569348096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535849.913319:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569348096:12345-0@lo:400:kworker.0 Request processed in 3164us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535849.913344:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788535849.914379:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569348096:0@lo:400:kworker.0 00010000:00010000:0.0:1788535850.156605:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535850.414501:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569349376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535850.414572:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535850.414798:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569349504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535850.414828:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535850.415005:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569349376 00000100:00100000:3.0:1788535850.415012:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569349376 00000100:00100000:3.0:1788535850.415048:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569349504 00000100:00100000:3.0:1788535850.415051:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569349504 00000100:00100000:3.0:1788535850.415066:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788535850.415074:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569349376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535850.415101:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535850.416068:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569349376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 989us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535850.416079:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788535850.416197:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788535850.416210:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569349504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535850.416225:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535850.416270:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569349504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535850.416285:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788535850.416322:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7aa00 x1875415569349504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535850.416353:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569349504:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788535850.416884:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488083480 x1875415569349376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535850.416900:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569349376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788535851.180465:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535851.436378:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788535851.436413:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569349760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535851.436596:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535851.436652:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569349632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535851.436675:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535851.436950:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569349760 00000100:00100000:2.0:1788535851.436972:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569349760 00000100:00100000:3.0:1788535851.437338:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569349632 00000100:00100000:3.0:1788535851.437343:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569349632 00000100:00100000:3.0:1788535851.437410:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788535851.437421:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569349632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788535851.437673:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535851.437743:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569349632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 324us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535851.437751:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788535851.437771:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788535851.437778:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569349760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535851.437789:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535851.437812:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569349760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535851.437818:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788535851.437845:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788535851.438031:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488080700 x1875415569349760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535851.438049:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569349760:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788535851.438060:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7a300 x1875415569349632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535851.438070:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569349632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535851.948788:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569349888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535851.948870:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535851.954192:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569349888 00000100:00100000:1.0:1788535851.954206:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569349888 00000100:00100000:1.0:1788535851.954274:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788535851.954286:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569349888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788535851.954331:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788535851.955019:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569349888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 733us (6146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535851.955101:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788535851.955324:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569349888:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788535852.204544:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535852.461797:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569350016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535852.461882:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535852.461951:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569350016 00000100:00100000:1.0:1788535852.461966:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569350016 00000100:00100000:1.0:1788535852.462012:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788535852.462021:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569350016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788535852.462055:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788535852.470310:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569350016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8280us (8416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535852.470336:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788535852.470390:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569350016:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788535853.229955:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535854.252686:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535854.468728:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535854.470577:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535854.470620:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535854.470660:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548307328 00000100:00100000:3.0:1788535854.470670:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548307328 00000100:00100000:3.0:1788535854.470717:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:3.0:1788535854.470726:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2402:x1875415548307328:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535854.470786:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2402:x1875415548307328:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535854.470793:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:1.0:1788535854.486328:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548307456 00000100:00100000:1.0:1788535854.486343:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548307456 00000100:00100000:1.0:1788535854.486418:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548307584 00000100:00100000:1.0:1788535854.486421:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548307584 00000100:00100000:1.0:1788535854.486449:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:1.0:1788535854.486460:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548307456:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535854.486561:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548307456:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 104us (17842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535854.486569:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:1.0:1788535854.486587:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:1.0:1788535854.486594:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548307584:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535854.486619:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548307584:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (15998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535854.486625:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00080000:1.0:1788535854.486659:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535854.486663:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535855.023395:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569350528:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023465:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023513:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569351040:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023536:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023561:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569351552:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023581:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023607:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788535855.023613:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569350144:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023652:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023672:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569350656:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023692:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023709:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569351168:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023729:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023755:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569351680:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023776:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023801:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569350272:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023822:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023837:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569350784:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023854:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023880:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569351296:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023899:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023916:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788535855.023921:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569350400:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023940:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.023968:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569350912:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.023987:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.024001:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569351424:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024018:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535855.024038:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569351040 00000100:00100000:3.0:1788535855.024046:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569351040 00000100:00100000:3.0:1788535855.024088:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569351552 00000100:00100000:3.0:1788535855.024091:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569351552 00000100:00100000:3.0:1788535855.024101:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569351168 00000100:00100000:3.0:1788535855.024103:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569351168 00000100:00100000:3.0:1788535855.024112:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569351680 00000100:00100000:3.0:1788535855.024114:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569351680 00000100:00100000:3.0:1788535855.024127:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788535855.024135:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569351040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024205:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569351040:12345-0@lo:400:kworker.0 Request processed in 69us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024221:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788535855.024239:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788535855.024245:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569351552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024275:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569351552:12345-0@lo:400:kworker.0 Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024281:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788535855.024292:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788535855.024309:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569351168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024334:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569351168:12345-0@lo:400:kworker.0 Request processed in 37us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024340:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788535855.024352:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788535855.024358:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569351680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024382:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569351680:12345-0@lo:400:kworker.0 Request processed in 25us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024387:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788535855.024406:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569350144 00000100:00100000:3.0:1788535855.024409:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569350144 00000100:00100000:3.0:1788535855.024435:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788535855.024441:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569350144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024468:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569350144:12345-0@lo:400:kworker.0 Request processed in 27us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024473:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788535855.024498:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569350656 00000100:00100000:3.0:1788535855.024502:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569350656 00000100:00100000:3.0:1788535855.024526:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569350400 00000100:00100000:3.0:1788535855.024529:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569350400 00000100:00100000:3.0:1788535855.024542:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788535855.024547:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024579:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569350656:12345-0@lo:400:kworker.0 Request processed in 31us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024584:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788535855.024597:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788535855.024603:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569350400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024632:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569350400:12345-0@lo:400:kworker.0 Request processed in 29us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024638:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788535855.024660:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569350528 00000100:00100000:3.0:1788535855.024664:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569350528 00000100:00100000:3.0:1788535855.024680:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569350272 00000100:00100000:3.0:1788535855.024683:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569350272 00000100:00100000:3.0:1788535855.024691:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569350784 00000100:00100000:3.0:1788535855.024694:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569350784 00000100:00100000:3.0:1788535855.024705:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569351296 00000100:00100000:3.0:1788535855.024707:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569351296 00000100:00100000:3.0:1788535855.024717:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569350912 00000100:00100000:3.0:1788535855.024720:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569350912 00000100:00100000:3.0:1788535855.024729:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569351424 00000100:00100000:3.0:1788535855.024732:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569351424 00000100:00100000:3.0:1788535855.024743:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788535855.024749:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569350528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024778:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569350528:12345-0@lo:400:kworker.0 Request processed in 29us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024784:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788535855.024801:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788535855.024806:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569350272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024833:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569350272:12345-0@lo:400:kworker.0 Request processed in 27us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024839:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788535855.024849:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788535855.024855:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569350784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024894:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569350784:12345-0@lo:400:kworker.0 Request processed in 39us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024901:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788535855.024914:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788535855.024920:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569351296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.024955:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569351296:12345-0@lo:400:kworker.0 Request processed in 23us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.024962:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788535855.024972:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788535855.024977:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569350912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.025000:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569350912:12345-0@lo:400:kworker.0 Request processed in 23us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.025006:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788535855.025015:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788535855.025021:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569351424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.025042:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569351424:12345-0@lo:400:kworker.0 Request processed in 21us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535855.025047:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788535855.025099:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569350400:0@lo:400:kworker.0 00010000:00080000:3.0:1788535855.025113:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e563800 x1875415569350912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535855.025123:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569350912:0@lo:400:kworker.0 00010000:00080000:3.0:1788535855.025133:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14f480 x1875415569351424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535855.025141:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569351424:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.025172:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569350272:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.025181:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569350784:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.025190:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569351296:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.025232:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569350144:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.025242:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569350656:0@lo:400:kworker.0 00010000:00080000:3.0:1788535855.025252:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14c380 x1875415569351168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535855.025261:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569351168:0@lo:400:kworker.0 00010000:00080000:3.0:1788535855.025271:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879cbb80 x1875415569351680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535855.025280:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569351680:0@lo:400:kworker.0 00000100:00100000:3.0:1788535855.025290:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569350528:0@lo:400:kworker.0 00010000:00080000:3.0:1788535855.025311:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14df80 x1875415569351040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535855.025326:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569351040:0@lo:400:kworker.0 00010000:00080000:3.0:1788535855.025338:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14fb80 x1875415569351552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535855.025345:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569351552:0@lo:400:kworker.0 00000100:00080000:1.0:1788535855.025888:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535855.025893:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535855.025896:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535855.025905:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788535855.276335:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535855.533799:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569351808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535855.533865:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535855.533976:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569351808 00000100:00100000:2.0:1788535855.533983:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569351808 00000100:00100000:2.0:1788535855.534028:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788535855.534036:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569351808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535855.534063:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535855.534112:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569351808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535855.534119:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788535855.534196:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb79880 x1875415569351808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535855.534216:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569351808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535855.535062:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535855.535078:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569351936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535855.535122:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535855.535237:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569351936 00000100:00100000:2.0:1788535855.535244:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569351936 00000100:00100000:0.0:1788535855.535352:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788535855.535363:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569351936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535855.535380:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535855.535424:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569351936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535855.535430:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788535855.535506:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb78380 x1875415569351936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535855.535522:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569351936:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788535856.301301:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535856.557735:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535856.557756:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569352064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535856.557828:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535856.557902:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569352064 00000100:00100000:2.0:1788535856.557910:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569352064 00000100:00100000:2.0:1788535856.557963:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788535856.557971:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569352064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788535856.557998:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535856.558040:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569352064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535856.558046:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788535856.558085:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7bb80 x1875415569352064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535856.558100:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569352064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535856.558390:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569352192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535856.558622:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535856.563529:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569352192 00000100:00100000:3.0:1788535856.563545:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569352192 00000100:00100000:3.0:1788535856.563624:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788535856.563634:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569352192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535856.563659:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535856.564598:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569352192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 961us (5971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535856.564608:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788535856.566525:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879ca680 x1875415569352192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535856.566562:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569352192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535857.068371:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569352320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535857.068465:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535857.071217:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569352320 00000100:00100000:1.0:1788535857.071232:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569352320 00000100:00100000:1.0:1788535857.072090:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788535857.072102:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569352320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788535857.072139:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788535857.076971:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569352320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4863us (8498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535857.076986:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788535857.082262:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569352320:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788535857.324377:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535857.581687:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569352448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535857.581757:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535857.581867:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569352448 00000100:00100000:0.0:1788535857.581876:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569352448 00000100:00100000:0.0:1788535857.581934:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788535857.581944:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569352448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788535857.581990:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788535857.582043:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569352448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535857.582050:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788535857.582143:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569352448:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788535858.370256:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535859.375620:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535859.581044:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535859.581083:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535859.581111:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535859.581138:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548307968 00000100:00100000:3.0:1788535859.581169:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548307968 00000100:00100000:3.0:1788535859.581222:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548307840 00000100:00100000:3.0:1788535859.581226:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548307840 00000100:00100000:3.0:1788535859.581250:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:3.0:1788535859.581282:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548307968:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535859.581638:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548307968:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 370us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535859.581647:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:3.0:1788535859.581666:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1788535859.581673:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548307840:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535859.581697:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548307840:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535859.581704:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00080000:3.0:1788535859.581725:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535859.581729:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535859.581796:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548307712 00000100:00100000:0.0:1788535859.581801:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548307712 00000100:00100000:0.0:1788535859.581837:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:0.0:1788535859.581844:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2402:x1875415548307712:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535859.581871:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2402:x1875415548307712:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535859.581878:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:0.0:1788535860.141444:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569352960:0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.141510:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535860.141571:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569353472:0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.141595:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535860.141613:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569353984:0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.141632:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535860.141665:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788535860.141669:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569352832:0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.141688:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535860.141704:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569353344:0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.141723:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535860.141739:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569353856:0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.141757:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535860.141784:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569352960 00000100:00100000:0.0:1788535860.141791:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569352960 00000100:00100000:0.0:1788535860.141823:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569353344 00000100:00100000:0.0:1788535860.141825:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569353344 00000100:00100000:0.0:1788535860.141846:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569353856 00000100:00100000:0.0:1788535860.141849:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569353856 00000100:00100000:0.0:1788535860.141866:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788535860.141873:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569352960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.141927:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569352960:12345-0@lo:400:kworker.0 Request processed in 53us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535860.141934:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788535860.141949:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788535860.141955:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569353344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.141979:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569353344:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535860.141985:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788535860.141994:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788535860.142000:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569353856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.142022:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569353856:12345-0@lo:400:kworker.0 Request processed in 23us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535860.142036:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788535860.142054:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569353472 00000100:00100000:0.0:1788535860.142057:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569353472 00000100:00100000:0.0:1788535860.142078:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569353984 00000100:00100000:0.0:1788535860.142080:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569353984 00000100:00100000:0.0:1788535860.142094:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788535860.142100:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569353472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.142129:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569353472:12345-0@lo:400:kworker.0 Request processed in 29us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535860.142135:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788535860.142171:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788535860.142179:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569353984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.142206:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569353984:12345-0@lo:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535860.142211:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788535860.142231:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569352832 00000100:00100000:0.0:1788535860.142234:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569352832 00000100:00100000:0.0:1788535860.142255:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788535860.142273:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569352832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.142304:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569352832:12345-0@lo:400:kworker.0 Request processed in 43us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535860.142310:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788535860.142354:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569352832:0@lo:400:kworker.0 00010000:00080000:0.0:1788535860.142368:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488081f80 x1875415569353344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535860.142378:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569353344:0@lo:400:kworker.0 00010000:00080000:0.0:1788535860.142398:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487a83480 x1875415569353856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535860.142407:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569353856:0@lo:400:kworker.0 00000100:00100000:0.0:1788535860.142416:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569352960:0@lo:400:kworker.0 00010000:00080000:0.0:1788535860.142424:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488082300 x1875415569353472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535860.142431:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569353472:0@lo:400:kworker.0 00010000:00080000:0.0:1788535860.142439:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487a83b80 x1875415569353984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535860.142447:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569353984:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.142600:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569352704:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.142631:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535860.142655:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569353216:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.142677:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535860.142693:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569353728:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.142712:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535860.142734:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788535860.142740:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569352576:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.142766:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535860.142786:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569353088:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.142816:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535860.142840:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569353600:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.142860:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535860.142873:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569354112:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.142892:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535860.142915:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569353088 00000100:00100000:2.0:1788535860.142919:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569353088 00000100:00100000:2.0:1788535860.142940:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788535860.142947:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569353088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.142981:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569353088:12345-0@lo:400:kworker.0 Request processed in 35us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.142987:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788535860.143003:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569352704 00000100:00100000:2.0:1788535860.143007:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569352704 00000100:00100000:2.0:1788535860.143023:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569353216 00000100:00100000:2.0:1788535860.143025:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569353216 00000100:00100000:2.0:1788535860.143037:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569353728 00000100:00100000:2.0:1788535860.143039:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569353728 00000100:00100000:2.0:1788535860.143106:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788535860.143112:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569352704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.143140:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569352704:12345-0@lo:400:kworker.0 Request processed in 28us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.143175:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788535860.143187:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788535860.143193:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569353216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.143221:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569353216:12345-0@lo:400:kworker.0 Request processed in 29us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.143237:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788535860.143249:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788535860.143255:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569353728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.143291:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569353728:12345-0@lo:400:kworker.0 Request processed in 37us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.143297:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788535860.143324:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569353088:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.143334:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569352704:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.143342:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569353216:0@lo:400:kworker.0 00000100:00100000:2.0:1788535860.143349:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569353728:0@lo:400:kworker.0 00000100:00080000:3.0:1788535860.143602:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535860.143607:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535860.143609:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535860.143611:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535860.143623:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569353600 00000100:00100000:3.0:1788535860.143627:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569353600 00000100:00100000:3.0:1788535860.143659:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569354112 00000100:00100000:3.0:1788535860.143663:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569354112 00000100:00100000:3.0:1788535860.143677:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788535860.143684:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569353600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535860.143724:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569353600:12345-0@lo:400:kworker.0 Request processed in 41us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535860.143730:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788535860.143742:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788535860.143748:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569354112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535860.143775:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569354112:12345-0@lo:400:kworker.0 Request processed in 27us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535860.143788:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788535860.143810:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569352576 00000100:00100000:3.0:1788535860.143813:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569352576 00000100:00100000:3.0:1788535860.143835:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788535860.143841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569352576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535860.143869:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569352576:12345-0@lo:400:kworker.0 Request processed in 28us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535860.143874:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788535860.143908:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569352576:0@lo:400:kworker.0 00010000:00080000:3.0:1788535860.143920:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488080700 x1875415569353600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535860.143928:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569353600:0@lo:400:kworker.0 00010000:00080000:3.0:1788535860.143937:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487a80700 x1875415569354112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535860.143943:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569354112:0@lo:400:kworker.0 00000100:00080000:2.0:1788535860.144075:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535860.144079:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788535860.396439:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535860.652507:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569354368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535860.652582:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535860.652711:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569354368 00000100:00100000:2.0:1788535860.652719:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569354368 00000100:00100000:0.0:1788535860.652746:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535860.652762:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569354240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535860.652780:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788535860.652791:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569354368:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535860.652801:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788535860.652822:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535860.652878:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569354368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.652885:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788535860.652900:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569354240 00000100:00100000:2.0:1788535860.652903:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569354240 00000100:00100000:2.0:1788535860.652916:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788535860.652921:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569354240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535860.652949:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535860.652982:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569354240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535860.652990:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788535860.653006:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7aa00 x1875415569354368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788535860.653020:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900485d90700 x1875415569354240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535860.653036:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569354240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535860.653039:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569354368:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788535861.420553:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535861.676528:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569354496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535861.676590:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535861.676592:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535861.676604:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569354624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535861.676629:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535861.676654:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569354496 00000100:00100000:3.0:1788535861.676657:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569354624 00000100:00100000:2.0:1788535861.676661:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569354496 00000100:00100000:2.0:1788535861.676696:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788535861.676705:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569354496:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535861.676725:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569354624 00002000:00000024:2.0:1788535861.676729:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535861.676778:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569354496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535861.676785:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788535861.676806:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788535861.676812:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569354624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788535861.676821:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535861.676850:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569354624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535861.676856:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788535861.676890:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879cb480 x1875415569354624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788535861.676893:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7aa00 x1875415569354496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535861.676910:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569354496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535861.676914:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569354624:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788535862.065060:0:12007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 11:31:00 (1788535860) === 00000100:00100000:1.0:1788535862.188534:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535862.188564:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569354752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788535862.188646:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535862.188848:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569354752 00000100:00100000:3.0:1788535862.188858:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569354752 00000100:00100000:3.0:1788535862.188916:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788535862.188927:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569354752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788535862.188963:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535862.189018:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569354752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535862.189024:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788535862.189103:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569354752:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535862.444573:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535862.695217:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535862.695770:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548308096 00000100:00100000:3.0:1788535862.695779:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548308096 00000100:00100000:3.0:1788535862.695847:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:3.0:1788535862.695857:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:8748:x1875415548308096:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788535862.695873:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535862.695889:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b165527c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535862.695917:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165527c expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535862.695928:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165527c expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535862.695937:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50e00, rc 0) 00000100:00100000:3.0:1788535862.695993:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8748:x1875415548308096:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 138us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535862.696000:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:3.0:1788535862.700745:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535862.700770:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569354880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535862.700851:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535862.700905:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569354880 00000100:00100000:2.0:1788535862.700914:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569354880 00000100:00100000:2.0:1788535862.700967:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788535862.700980:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569354880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788535862.701016:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788535862.701303:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569354880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 316us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535862.701311:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788535862.701495:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569354880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535862.709019:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535862.709615:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548308224 00000100:00100000:0.0:1788535862.709625:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548308224 00000100:00100000:0.0:1788535862.709685:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 289 00000100:00100000:0.0:1788535862.709695:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8748:x1875415548308224:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788535862.709849:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8748:x1875415548308224:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 155us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.709872:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 289 00000100:00100000:1.0:1788535862.718844:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535862.719094:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548308352 00000100:00100000:0.0:1788535862.719104:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548308352 00000100:00100000:0.0:1788535862.719459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:0.0:1788535862.719471:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8748:x1875415548308352:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788535862.719616:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8748:x1875415548308352:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 146us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.719625:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:1.0:1788535862.724950:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535862.725029:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548308480 00000100:00100000:3.0:1788535862.725038:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548308480 00000100:00100000:3.0:1788535862.725089:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 291 00000100:00100000:3.0:1788535862.725098:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8752:x1875415548308480:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788535862.725285:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8752:x1875415548308480:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 186us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535862.725293:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 291 00000100:00100000:2.0:1788535862.770590:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535862.770727:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548308608 00000100:00100000:3.0:1788535862.770736:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548308608 00000100:00100000:3.0:1788535862.770799:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:3.0:1788535862.770809:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8752:x1875415548308608:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788535862.770981:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8752:x1875415548308608:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 172us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535862.770988:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:1.0:1788535862.778857:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535862.779110:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548308736 00000100:00100000:0.0:1788535862.779120:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548308736 00000100:00100000:0.0:1788535862.779214:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 293 00000100:00100000:0.0:1788535862.779226:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8752:x1875415548308736:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788535862.779408:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8752:x1875415548308736:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 184us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.779416:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 293 00000100:00100000:1.0:1788535862.788662:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535862.788756:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548308864 00000100:00100000:0.0:1788535862.788767:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548308864 00000100:00100000:0.0:1788535862.788828:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:0.0:1788535862.788839:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+11:8748:x1875415548308864:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788535862.788858:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535862.788875:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc54c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b16552ad expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535862.788909:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ad expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535862.788942:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ad expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535862.788952:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454800, rc 0) 00000100:00100000:0.0:1788535862.789042:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+12:8748:x1875415548308864:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 204us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.789050:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:2.0:1788535862.796739:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535862.796841:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548308992 00000100:00100000:3.0:1788535862.796851:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548308992 00000100:00100000:3.0:1788535862.796910:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 295 00000100:00100000:3.0:1788535862.796920:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+12:8748:x1875415548308992:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788535862.796945:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788535862.796970:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788535862.796974:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788535862.796978:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788535862.796987:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788535862.796990:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788535862.799540:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+12:8748:x1875415548308992:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 2610us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535862.799553:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 295 00000100:00100000:1.0:1788535862.802230:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535862.802474:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548309120 00000100:00100000:3.0:1788535862.802483:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548309120 00000100:00100000:3.0:1788535862.802544:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:3.0:1788535862.802556:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+12:8748:x1875415548309120:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788535862.802583:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535862.802601:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b16552b4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535862.802633:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552b4 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535862.802645:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552b4 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535862.802654:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51200, rc 0) 00000100:00100000:3.0:1788535862.802713:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:8748:x1875415548309120:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 159us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535862.802720:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:2.0:1788535862.805348:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535862.805492:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548309248 00000100:00100000:3.0:1788535862.805501:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548309248 00000100:00100000:3.0:1788535862.805560:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 297 00000100:00100000:3.0:1788535862.805569:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:8748:x1875415548309248:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788535862.805792:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:8748:x1875415548309248:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 223us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535862.805813:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 297 00000100:00100000:1.0:1788535862.809141:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535862.809364:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548309376 00000100:00100000:0.0:1788535862.809374:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548309376 00000100:00100000:0.0:1788535862.809471:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00100000:0.0:1788535862.809481:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:8748:x1875415548309376:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788535862.809663:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:8748:x1875415548309376:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 182us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.809672:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00100000:1.0:1788535862.820137:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535862.820539:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548309504 00000100:00100000:0.0:1788535862.820550:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548309504 00000100:00100000:0.0:1788535862.820654:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 299 00000100:00100000:0.0:1788535862.820665:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:8756:x1875415548309504:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788535862.820816:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:8756:x1875415548309504:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 152us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.820824:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 299 00000100:00100000:2.0:1788535862.836813:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535862.838523:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548309632 00000100:00100000:0.0:1788535862.838538:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548309632 00000100:00100000:0.0:1788535862.838605:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 300 00000100:00100000:0.0:1788535862.838615:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:8756:x1875415548309632:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788535862.838778:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:8756:x1875415548309632:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 163us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.838786:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 300 00000100:00100000:1.0:1788535862.851273:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535862.851439:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535862.851563:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535862.863183:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535862.865720:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548309760 00000100:00100000:0.0:1788535862.865736:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548309760 00000100:00100000:0.0:1788535862.865791:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548310016 00000100:00100000:0.0:1788535862.865794:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548310016 00000100:00100000:0.0:1788535862.865805:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548310272 00000100:00100000:0.0:1788535862.865807:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548310272 00000100:00100000:0.0:1788535862.865848:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1788535862.865857:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548310272:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535862.865932:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548310272:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (14369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.865939:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1788535862.865954:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1788535862.865958:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1875415548309760:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788535862.865977:0:10112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8d9ac97c-7faa-47b0-a267-eea08d7bbce2@192.168.203.13@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1788535862.866015:0:10112:0:(genops.c:1385:class_connect()) connect: client 8d9ac97c-7faa-47b0-a267-eea08d7bbce2, cookie 0xe79af2f39bbdc55a 00000004:00100000:0.0:1788535862.866036:0:10112:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788535862.866175:0:10112:0:(import.c:65:import_set_state_nolock()) ffff9004878ec800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535862.866206:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2398:x1875415548309760:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 246us (14943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.866213:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1788535862.866226:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788535862.866231:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2398:x1875415548310016:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788535862.866268:0:10112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8d9ac97c-7faa-47b0-a267-eea08d7bbce2@192.168.203.13@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1788535862.869254:0:10112:0:(genops.c:1385:class_connect()) connect: client 8d9ac97c-7faa-47b0-a267-eea08d7bbce2, cookie 0xe79af2f39bbdc561 00000004:00100000:0.0:1788535862.869394:0:10112:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788535862.870258:0:10112:0:(import.c:65:import_set_state_nolock()) ffff9004878ed800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535862.870519:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2398:x1875415548310016:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 4272us (19066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.870531:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00080000:0.0:1788535862.870875:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535862.878749:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548310144 00000100:00100000:0.0:1788535862.878763:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548310144 00000100:00100000:0.0:1788535862.878848:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:0.0:1788535862.878859:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548310144:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535862.878932:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548310144:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 74us (15758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.878941:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1788535862.879012:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535862.879039:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548310400 00000100:00100000:1.0:1788535862.879044:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548310400 00000100:00100000:1.0:1788535862.879126:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1788535862.879135:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:0:x1875415548310400:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788535862.879179:0:10016:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788535862.879259:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:0:x1875415548310400:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 125us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535862.879266:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1788535862.881123:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535862.881196:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535862.882707:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548310528 00000100:00100000:0.0:1788535862.882732:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548310528 00000100:00100000:0.0:1788535862.882800:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548309888 00000100:00100000:0.0:1788535862.882804:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548309888 00000100:00100000:0.0:1788535862.882842:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1788535862.882853:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+7:8748:x1875415548310528:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788535862.882883:0:10112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788535862.882984:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+7:8748:x1875415548310528:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 133us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.882992:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1788535862.883010:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788535862.883032:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:0:x1875415548309888:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788535862.883044:0:10112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788535862.883065:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:0:x1875415548309888:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 34us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535862.883070:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00080000:2.0:1788535862.883457:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535862.883463:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535862.891133:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535862.891390:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548310656 00000100:00100000:2.0:1788535862.891399:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548310656 00000100:00100000:2.0:1788535862.891464:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788535862.891474:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:8748:x1875415548310656:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788535862.891548:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:8748:x1875415548310656:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 75us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535862.891668:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788535862.898026:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535862.898293:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548310784 00000100:00100000:3.0:1788535862.898302:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548310784 00000100:00100000:2.0:1788535862.898464:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1788535862.898473:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1875415548310784:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788535862.898508:0:8448:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8d9ac97c-7faa-47b0-a267-eea08d7bbce2@192.168.203.13@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1788535862.898549:0:8448:0:(genops.c:1385:class_connect()) connect: client 8d9ac97c-7faa-47b0-a267-eea08d7bbce2, cookie 0xe79af2f39bbdc568 00002000:00100000:2.0:1788535862.898562:0:8448:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8d9ac97c-7faa-47b0-a267-eea08d7bbce2/ffff90059fb0a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788535862.898573:0:8448:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788535862.898645:0:8448:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788535862.898675:0:8448:0:(import.c:65:import_set_state_nolock()) ffff90059fb0e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788535862.898785:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2398:x1875415548310784:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 310us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535862.898793:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788535862.904778:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535862.904951:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548310912 00000100:00100000:2.0:1788535862.904960:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548310912 00000100:00100000:2.0:1788535862.905007:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788535862.905015:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1875415548310912:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788535862.905048:0:8447:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8d9ac97c-7faa-47b0-a267-eea08d7bbce2@192.168.203.13@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:2.0:1788535862.905077:0:8447:0:(genops.c:1385:class_connect()) connect: client 8d9ac97c-7faa-47b0-a267-eea08d7bbce2, cookie 0xe79af2f39bbdc56f 00002000:00100000:2.0:1788535862.905087:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8d9ac97c-7faa-47b0-a267-eea08d7bbce2/ffff90059fb0a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788535862.905102:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788535862.905207:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788535862.905237:0:8447:0:(import.c:65:import_set_state_nolock()) ffff90059fb09800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788535862.905319:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2398:x1875415548310912:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 303us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535862.905326:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788535862.909463:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535862.909748:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548311040 00000100:00100000:2.0:1788535862.909757:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548311040 00000100:00100000:2.0:1788535862.909816:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788535862.909827:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:8748:x1875415548311040:12345-192.168.203.13@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788535862.909927:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:8748:x1875415548311040:12345-192.168.203.13@tcp:900:mount.lustre.0 Request processed in 101us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535862.909935:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1788535862.912786:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535862.912884:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548311168 00000100:00100000:2.0:1788535862.912894:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548311168 00000100:00100000:2.0:1788535862.912955:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1788535862.912965:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:8748:x1875415548311168:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788535862.913051:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788535862.913528:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:8748:x1875415548311168:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 562us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535862.913537:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00010000:00010000:1.0:1788535863.468440:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535864.495337:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535865.260916:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569355264:0@lo:400:kworker.0 00000100:00100000:1.0:1788535865.260961:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569355136:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.260989:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535865.261003:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535865.261081:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569355008:0@lo:400:kworker.0 00000100:00100000:3.0:1788535865.261116:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535865.261216:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569355392:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.261274:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535865.261313:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569355136 00000100:00100000:2.0:1788535865.261321:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569355136 00000100:00100000:2.0:1788535865.261363:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569355392 00000100:00100000:2.0:1788535865.261367:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569355392 00000100:00100000:2.0:1788535865.261398:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788535865.261407:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569355136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.261420:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569355776:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.261465:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569355136:12345-0@lo:400:kworker.0 Request processed in 58us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.261470:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535865.261479:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788535865.261496:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569355776 00000100:00100000:2.0:1788535865.261504:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569355776 00000100:00100000:2.0:1788535865.261528:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788535865.261534:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569355392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.261569:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569355392:12345-0@lo:400:kworker.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535865.261577:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788535865.261592:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788535865.261599:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569355776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.261622:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569355776:12345-0@lo:400:kworker.0 Request processed in 24us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535865.261629:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:0.0:1788535865.261648:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3800 x1875415569355776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788535865.261656:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535865.261662:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569355776:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.261671:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569356288:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.261692:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569355392:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.261701:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569355904:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.261702:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535865.261755:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569355520:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.262298:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569355264 00000100:00100000:0.0:1788535865.262304:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569355264 00000100:00100000:0.0:1788535865.262346:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788535865.262355:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569355264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.262397:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569355264:12345-0@lo:400:kworker.0 Request processed in 43us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.262403:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788535865.262577:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569355008 00000100:00100000:0.0:1788535865.262582:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569355008 00000100:00100000:0.0:1788535865.262613:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788535865.262619:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569355008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.262660:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569355008:12345-0@lo:400:kworker.0 Request processed in 41us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.262670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788535865.262711:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569356288 00000100:00100000:0.0:1788535865.262715:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569356288 00000100:00100000:0.0:1788535865.262744:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788535865.262751:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569356288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.262780:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569356288:12345-0@lo:400:kworker.0 Request processed in 30us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.262787:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:0.0:1788535865.262823:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894aed80 x1875415569356288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535865.262836:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569356288:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.262850:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569355264:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.264598:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535865.264644:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569356416:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.264680:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535865.264760:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569355904 00000100:00100000:2.0:1788535865.264767:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569355904 00000100:00100000:2.0:1788535865.264812:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569356416 00000100:00100000:2.0:1788535865.264816:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569356416 00000100:00100000:2.0:1788535865.264845:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788535865.264855:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569355904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.264912:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569355904:12345-0@lo:400:kworker.0 Request processed in 58us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535865.264919:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788535865.264933:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788535865.264939:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569356416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535865.264971:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535865.264987:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569356416:12345-0@lo:400:kworker.0 Request processed in 47us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535865.264994:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788535865.265005:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569356032:0@lo:400:kworker.0 00000100:00080000:2.0:1788535865.265025:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535865.265032:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535865.265050:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569356544:0@lo:400:kworker.0 00000100:00100000:3.0:1788535865.265070:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535865.265098:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569355008:0@lo:400:kworker.0 00000100:00080000:2.0:1788535865.265250:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535865.265254:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535865.265264:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569356032 00000100:00100000:2.0:1788535865.265268:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569356032 00000100:00100000:2.0:1788535865.265298:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569356544 00000100:00100000:2.0:1788535865.265301:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569356544 00000100:00100000:2.0:1788535865.265318:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788535865.265325:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569356032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.265363:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569356032:12345-0@lo:400:kworker.0 Request processed in 38us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535865.265369:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788535865.265387:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788535865.265394:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569356544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.265421:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569356544:12345-0@lo:400:kworker.0 Request processed in 29us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535865.265427:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788535865.265460:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535865.265463:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788535865.265489:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3b80 x1875415569356032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535865.265501:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569356032:0@lo:400:kworker.0 00010000:00080000:2.0:1788535865.265516:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ad500 x1875415569356544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535865.265519:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569355520 00000100:00100000:0.0:1788535865.265525:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569355520 00000100:00100000:2.0:1788535865.265541:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569356544:0@lo:400:kworker.0 00010000:00080000:2.0:1788535865.265574:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf0e00 x1875415569355904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535865.265582:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569355904:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.265593:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1788535865.265597:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894af100 x1875415569356416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535865.265605:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569355520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.265611:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569356416:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.265667:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569355520:12345-0@lo:400:kworker.0 Request processed in 66us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535865.265674:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788535865.265691:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569355520:0@lo:400:kworker.0 00000100:00100000:1.0:1788535865.265935:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569355136:0@lo:400:kworker.0 00000100:00100000:1.0:1788535865.265945:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569355648:0@lo:400:kworker.0 00000100:00100000:1.0:1788535865.265982:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535865.266316:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569356160:0@lo:400:kworker.0 00000100:00100000:0.0:1788535865.266350:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535865.268280:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569355648 00000100:00100000:3.0:1788535865.268293:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569355648 00000100:00080000:1.0:1788535865.268496:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535865.268789:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569356160 00000100:00100000:2.0:1788535865.268795:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569356160 00000100:00100000:2.0:1788535865.268853:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788535865.268863:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569355648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.268958:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569355648:12345-0@lo:400:kworker.0 Request processed in 97us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535865.268966:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788535865.268987:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788535865.268994:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569356160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.269129:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569356160:12345-0@lo:400:kworker.0 Request processed in 136us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535865.269137:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788535865.269219:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569355648:0@lo:400:kworker.0 00000100:00100000:2.0:1788535865.269243:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569356160:0@lo:400:kworker.0 00000100:00080000:1.0:1788535865.269340:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788535865.517616:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535865.772819:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569356672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535865.772894:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535865.781514:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569356672 00000100:00100000:0.0:1788535865.781527:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569356672 00000100:00100000:1.0:1788535865.781749:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569356800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535865.781815:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535865.782050:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569356800 00000100:00100000:1.0:1788535865.782054:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569356800 00000100:00100000:1.0:1788535865.782073:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788535865.782081:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569356672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535865.782110:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535865.782188:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569356672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (9292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535865.782195:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788535865.782215:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788535865.782231:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569356800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788535865.782242:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535865.782276:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569356800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535865.782282:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788535865.782831:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894af100 x1875415569356800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535865.782852:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569356800:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788535865.784132:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ac380 x1875415569356672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535865.784180:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569356672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788535866.540691:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535866.797460:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569356928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788535866.797524:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535866.798092:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569356928 00000100:00100000:0.0:1788535866.798101:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569356928 00000100:00100000:0.0:1788535866.798162:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788535866.798172:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569356928:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535866.798390:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569357056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535866.798431:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535866.798477:0:8450:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788535866.798485:0:8450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788535866.798550:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569357056 00000100:00100000:2.0:1788535866.798555:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569357056 00000100:00100000:2.0:1788535866.798644:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788535866.798651:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569357056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788535866.798676:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535866.798899:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569357056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 248us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535866.798907:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788535866.798945:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14c700 x1875415569357056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535866.798965:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569357056:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788535866.799239:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535866.801056:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569356928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2879us (3525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535866.801067:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788535866.801283:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488168380 x1875415569356928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535866.801304:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569356928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535867.308997:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535867.309022:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569357184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788535867.309090:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535867.309182:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569357184 00000100:00100000:3.0:1788535867.309191:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569357184 00000100:00100000:3.0:1788535867.309250:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788535867.309259:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569357184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788535867.309300:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535867.309355:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569357184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535867.309371:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788535867.309420:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569357184:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535867.565003:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535867.821893:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535867.821915:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569357312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535867.821985:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535867.822054:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569357312 00000100:00100000:3.0:1788535867.822061:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569357312 00000100:00100000:3.0:1788535867.822115:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788535867.822124:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ba817c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569357312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535867.822173:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788535867.822229:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ba817c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569357312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535867.822236:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788535867.823032:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569357312:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788535867.974445:0:12201:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1788535868.282434:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535868.282476:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535868.282508:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535868.282591:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535868.282610:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535868.282871:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548311296 00000100:00100000:3.0:1788535868.282881:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548311296 00000100:00100000:3.0:1788535868.282935:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 302 00000100:00100000:3.0:1788535868.282945:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548311296:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535868.283010:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548311296:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535868.283017:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 302 00000100:00100000:3.0:1788535868.283188:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548312064 00000100:00100000:3.0:1788535868.283192:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548312064 00000100:00100000:3.0:1788535868.283240:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1788535868.283246:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2401:x1875415548312064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535868.283289:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2401:x1875415548312064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535868.283295:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00080000:3.0:1788535868.283330:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788535868.285793:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535868.286301:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548311552 00000100:00100000:1.0:1788535868.286334:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548311552 00000100:00100000:1.0:1788535868.286391:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548311808 00000100:00100000:1.0:1788535868.286394:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548311808 00000100:00100000:1.0:1788535868.286416:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548311424 00000100:00100000:1.0:1788535868.286418:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548311424 00000100:00100000:1.0:1788535868.286437:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:1.0:1788535868.286445:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548311552:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535868.286516:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548311552:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (4038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535868.286524:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:1.0:1788535868.286541:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:1.0:1788535868.286547:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2401:x1875415548311808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535868.286570:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2401:x1875415548311808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (4061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535868.286576:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:1.0:1788535868.286586:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:1.0:1788535868.286593:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548311424:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535868.286613:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548311424:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (4003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535868.286619:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00080000:1.0:1788535868.286981:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535868.286986:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535868.287342:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535868.287366:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548311936 00000100:00100000:0.0:1788535868.287372:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548311936 00000100:00100000:0.0:1788535868.287411:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1788535868.287431:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2401:x1875415548311936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535868.287471:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2401:x1875415548311936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535868.287478:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00080000:0.0:1788535868.287514:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535868.287616:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548311680 00000100:00100000:1.0:1788535868.287621:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548311680 00000100:00100000:1.0:1788535868.287658:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:1.0:1788535868.287664:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2401:x1875415548311680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535868.287714:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2401:x1875415548311680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 49us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535868.287721:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00080000:0.0:1788535868.289184:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788535868.334048:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000001:00100000:2.0:1788535868.334731:0:7464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00010000:00010000:0.0:1788535868.588765:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788535869.363291:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000001:00100000:0.0:1788535869.365803:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00010000:00010000:0.0:1788535869.612529:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535870.381565:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569357696:0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.381683:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535870.381729:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569358208:0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.381754:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535870.381775:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569358720:0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.381796:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535870.381822:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788535870.381828:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569357824:0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.381848:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535870.381863:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569358336:0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.381883:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535870.381900:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569358848:0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.381920:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535870.381948:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569358336 00000100:00100000:0.0:1788535870.381956:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569358336 00000100:00100000:0.0:1788535870.382002:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569358848 00000100:00100000:0.0:1788535870.382005:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569358848 00000100:00100000:0.0:1788535870.382036:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788535870.382045:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569358336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.382096:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569358336:12345-0@lo:400:kworker.0 Request processed in 52us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535870.382104:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788535870.382120:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788535870.382126:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569358848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.382182:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569358848:12345-0@lo:400:kworker.0 Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535870.382198:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788535870.382219:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535870.382223:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788535870.382252:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf0e00 x1875415569358336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535870.382266:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569358336:0@lo:400:kworker.0 00010000:00080000:0.0:1788535870.382278:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3800 x1875415569358848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535870.382286:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569358848:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382455:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569357568:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382484:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.382510:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569358080:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382532:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.382556:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569358592:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382576:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.382594:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788535870.382600:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569357440:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382623:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.382642:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569357952:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382662:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.382681:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569358464:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382699:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.382712:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569358976:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382731:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535870.382755:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569358208 00000100:00100000:2.0:1788535870.382759:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569358208 00000100:00100000:2.0:1788535870.382786:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569358720 00000100:00100000:2.0:1788535870.382789:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569358720 00000100:00100000:2.0:1788535870.382800:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569357824 00000100:00100000:2.0:1788535870.382803:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569357824 00000100:00100000:2.0:1788535870.382812:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569357568 00000100:00100000:2.0:1788535870.382814:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569357568 00000100:00100000:2.0:1788535870.382824:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569358080 00000100:00100000:2.0:1788535870.382826:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569358080 00000100:00100000:2.0:1788535870.382836:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569358592 00000100:00100000:2.0:1788535870.382838:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569358592 00000100:00100000:2.0:1788535870.382850:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788535870.382856:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569358208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382890:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569358208:12345-0@lo:400:kworker.0 Request processed in 34us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.382902:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788535870.382915:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788535870.382920:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569358720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382946:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569358720:12345-0@lo:400:kworker.0 Request processed in 25us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.382951:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788535870.382960:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788535870.382966:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569357824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.382989:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569357824:12345-0@lo:400:kworker.0 Request processed in 23us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.382994:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788535870.383004:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788535870.383009:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569357568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.383039:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569357568:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.383044:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788535870.383054:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788535870.383059:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569358080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.383080:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569358080:12345-0@lo:400:kworker.0 Request processed in 21us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.383084:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788535870.383093:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788535870.383098:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569358592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.383120:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569358592:12345-0@lo:400:kworker.0 Request processed in 22us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.383130:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788535870.383169:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569357696 00000100:00100000:2.0:1788535870.383173:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569357696 00000100:00100000:2.0:1788535870.383202:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569357952 00000100:00100000:2.0:1788535870.383205:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569357952 00000100:00100000:2.0:1788535870.383217:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788535870.383223:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569357696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.383257:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569357696:12345-0@lo:400:kworker.0 Request processed in 33us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.383262:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788535870.383274:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788535870.383279:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569357952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.383305:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569357952:12345-0@lo:400:kworker.0 Request processed in 25us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535870.383310:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788535870.383337:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569357952:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.383348:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569357568:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.383356:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569358080:0@lo:400:kworker.0 00000100:00100000:2.0:1788535870.383364:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569358592:0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.383608:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569357440 00000100:00100000:0.0:1788535870.383613:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569357440 00000100:00100000:0.0:1788535870.383652:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788535870.383659:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569357440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.383704:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569357440:12345-0@lo:400:kworker.0 Request processed in 46us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535870.383711:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788535870.383743:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569358464 00000100:00100000:0.0:1788535870.383746:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569358464 00000100:00100000:0.0:1788535870.383769:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569358976 00000100:00100000:0.0:1788535870.383772:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569358976 00000100:00100000:0.0:1788535870.383790:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788535870.383796:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569358464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.383825:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569358464:12345-0@lo:400:kworker.0 Request processed in 30us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535870.383831:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788535870.383843:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788535870.383849:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569358976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.383872:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569358976:12345-0@lo:400:kworker.0 Request processed in 25us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535870.383877:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788535870.383894:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535870.383898:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535870.383900:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788535870.383902:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535870.383924:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569357824:0@lo:400:kworker.0 00000100:00100000:0.0:1788535870.383934:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569357696:0@lo:400:kworker.0 00010000:00080000:0.0:1788535870.383945:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf1500 x1875415569358208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535870.383955:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569358208:0@lo:400:kworker.0 00010000:00080000:0.0:1788535870.383965:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf1f80 x1875415569358720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535870.383972:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569358720:0@lo:400:kworker.0 00000100:00100000:1.0:1788535870.384058:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569357440:0@lo:400:kworker.0 00010000:00080000:1.0:1788535870.384069:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3b80 x1875415569358464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535870.384078:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569358464:0@lo:400:kworker.0 00010000:00080000:1.0:1788535870.384087:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488082680 x1875415569358976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535870.384095:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569358976:0@lo:400:kworker.0 00010000:00010000:2.0:1788535870.637442:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535870.892760:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569359104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535870.892831:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535870.892968:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569359104 00000100:00100000:0.0:1788535870.892976:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569359104 00000100:00100000:0.0:1788535870.893030:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788535870.893038:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569359104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535870.893065:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535870.893114:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569359104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535870.893120:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1788535870.893208:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894adf80 x1875415569359104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535870.893225:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569359104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535870.893484:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788535870.893493:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569359232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535870.893522:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535870.893553:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569359232 00000100:00100000:1.0:1788535870.893557:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569359232 00000100:00100000:1.0:1788535870.893580:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788535870.893587:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569359232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788535870.893597:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535870.893626:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569359232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535870.893645:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788535870.893672:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894adf80 x1875415569359232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535870.893685:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569359232:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788535871.663985:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535871.916916:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569359360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788535871.916993:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535871.917060:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535871.917074:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569359488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535871.917098:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569359360 00000100:00100000:1.0:1788535871.917105:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569359360 00000100:00100000:0.0:1788535871.917110:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535871.917176:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569359488 00000100:00100000:1.0:1788535871.917190:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569359488 00000100:00100000:1.0:1788535871.917218:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788535871.917227:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569359360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788535871.917253:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535871.917306:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569359360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535871.917312:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788535871.917328:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788535871.917334:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569359488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535871.917342:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535871.917376:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569359488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535871.917382:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788535871.917460:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e14f480 x1875415569359488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535871.917495:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569359488:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788535871.917579:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048816b480 x1875415569359360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535871.917592:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569359360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535872.429088:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535872.429110:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569359616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788535872.429210:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535872.429269:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569359616 00000100:00100000:3.0:1788535872.429278:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569359616 00000100:00100000:3.0:1788535872.429335:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788535872.429343:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569359616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788535872.429372:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535872.429706:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569359616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 362us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535872.429713:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788535872.429805:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569359616:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535872.684461:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535872.940519:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569359744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535872.940587:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535872.941078:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569359744 00000100:00100000:3.0:1788535872.941088:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569359744 00000100:00100000:3.0:1788535872.941138:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788535872.941278:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569359744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535872.941373:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788535872.941473:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569359744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 325us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535872.941480:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788535872.948769:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569359744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535873.408596:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535873.408635:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535873.408663:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535873.408703:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535873.408726:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535873.408746:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535873.408773:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548312320 00000100:00100000:0.0:1788535873.408783:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548312320 00000100:00100000:0.0:1788535873.408850:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548312576 00000100:00100000:0.0:1788535873.408854:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548312576 00000100:00100000:0.0:1788535873.408869:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548312448 00000100:00100000:0.0:1788535873.408871:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548312448 00000100:00100000:0.0:1788535873.408882:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548312704 00000100:00100000:0.0:1788535873.408884:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548312704 00000100:00100000:0.0:1788535873.408899:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:0.0:1788535873.408910:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2399:x1875415548312320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535873.408999:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2399:x1875415548312320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 91us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535873.409007:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:0.0:1788535873.409023:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:0.0:1788535873.409028:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548312576:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535873.409046:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548312576:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 19us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535873.409050:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:0.0:1788535873.409056:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:0.0:1788535873.409059:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548312448:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535873.409070:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548312448:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 11us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535873.409074:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:0.0:1788535873.409080:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:0.0:1788535873.409083:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548312704:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535873.409095:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548312704:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 11us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535873.409098:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00080000:0.0:1788535873.409109:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788535873.409112:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535873.410031:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548312832 00000100:00100000:2.0:1788535873.410039:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548312832 00000100:00100000:2.0:1788535873.410078:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1788535873.410085:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548312832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535873.410120:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548312832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535873.410124:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00080000:2.0:1788535873.410140:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535873.410181:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548312192 00000100:00100000:2.0:1788535873.410185:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548312192 00000100:00100000:2.0:1788535873.410211:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 304 00000100:00100000:2.0:1788535873.410218:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548312192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535873.410247:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548312192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535873.410253:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 304 00000100:00100000:3.0:1788535873.411036:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535873.412100:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548312960 00000100:00100000:2.0:1788535873.412112:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548312960 00000100:00100000:2.0:1788535873.412214:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1788535873.412225:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548312960:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535873.412294:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548312960:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (3520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535873.412301:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00080000:3.0:1788535873.412730:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788535873.709915:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788535874.513519:0:12517:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788535874.513739:0:12517:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788535874.732979:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535875.505474:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569359872:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505538:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505583:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569360384:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505615:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505634:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569360896:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505654:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505668:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569361408:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505683:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505703:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788535875.505708:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569360256:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505726:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505738:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569360768:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505752:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505763:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569361280:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505778:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505798:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569360000:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505816:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505829:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569360512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505844:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505856:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569361024:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505883:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505898:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788535875.505902:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569360128:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505918:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505930:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e01aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569360640:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505944:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505956:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569361152:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.505978:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535875.505999:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569360384 00000100:00100000:0.0:1788535875.506006:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569360384 00000100:00100000:0.0:1788535875.506037:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569360128 00000100:00100000:0.0:1788535875.506039:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569360128 00000100:00100000:0.0:1788535875.506051:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788535875.506058:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569360384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506099:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569360384:12345-0@lo:400:kworker.0 Request processed in 41us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506106:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788535875.506121:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788535875.506126:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569360128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506180:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569360128:12345-0@lo:400:kworker.0 Request processed in 54us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506186:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788535875.506201:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569360896 00000100:00100000:0.0:1788535875.506204:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569360896 00000100:00100000:0.0:1788535875.506225:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569361408 00000100:00100000:0.0:1788535875.506227:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569361408 00000100:00100000:0.0:1788535875.506235:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569360768 00000100:00100000:0.0:1788535875.506237:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569360768 00000100:00100000:0.0:1788535875.506246:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569361280 00000100:00100000:0.0:1788535875.506248:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569361280 00000100:00100000:0.0:1788535875.506258:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788535875.506263:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569360896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506287:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569360896:12345-0@lo:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506292:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788535875.506308:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788535875.506312:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569361408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506334:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569361408:12345-0@lo:400:kworker.0 Request processed in 22us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506339:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788535875.506347:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788535875.506352:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569360768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506369:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569360768:12345-0@lo:400:kworker.0 Request processed in 17us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506374:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788535875.506381:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788535875.506386:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569361280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506403:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569361280:12345-0@lo:400:kworker.0 Request processed in 17us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506408:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788535875.506423:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569360256 00000100:00100000:0.0:1788535875.506426:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569360256 00000100:00100000:0.0:1788535875.506439:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569360000 00000100:00100000:0.0:1788535875.506441:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569360000 00000100:00100000:0.0:1788535875.506449:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569360512 00000100:00100000:0.0:1788535875.506450:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569360512 00000100:00100000:0.0:1788535875.506459:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569361024 00000100:00100000:0.0:1788535875.506461:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569361024 00000100:00100000:0.0:1788535875.506469:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569360640 00000100:00100000:0.0:1788535875.506471:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569360640 00000100:00100000:0.0:1788535875.506479:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569361152 00000100:00100000:0.0:1788535875.506481:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569361152 00000100:00100000:0.0:1788535875.506490:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788535875.506495:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569360256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506524:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569360256:12345-0@lo:400:kworker.0 Request processed in 29us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506529:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788535875.506538:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788535875.506543:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569360000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506560:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569360000:12345-0@lo:400:kworker.0 Request processed in 18us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506565:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788535875.506573:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788535875.506578:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569360512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506597:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569360512:12345-0@lo:400:kworker.0 Request processed in 19us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506601:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788535875.506609:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788535875.506613:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569361024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506633:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569361024:12345-0@lo:400:kworker.0 Request processed in 19us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506638:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788535875.506646:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788535875.506652:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569360640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506671:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569360640:12345-0@lo:400:kworker.0 Request processed in 19us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506676:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788535875.506683:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788535875.506687:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569361152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506713:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569361152:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535875.506719:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788535875.506764:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569360256:0@lo:400:kworker.0 00010000:00080000:0.0:1788535875.506775:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e01a680 x1875415569360768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535875.506785:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569360768:0@lo:400:kworker.0 00010000:00080000:0.0:1788535875.506793:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e018700 x1875415569361280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535875.506801:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569361280:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506809:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569360384:0@lo:400:kworker.0 00010000:00080000:0.0:1788535875.506816:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e01bb80 x1875415569360896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535875.506822:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569360896:0@lo:400:kworker.0 00010000:00080000:0.0:1788535875.506830:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e01b100 x1875415569361408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535875.506837:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569361408:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506867:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569360128:0@lo:400:kworker.0 00010000:00080000:0.0:1788535875.506875:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e01aa00 x1875415569360640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535875.506883:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e01aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569360640:0@lo:400:kworker.0 00010000:00080000:0.0:1788535875.506899:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e018a80 x1875415569361152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535875.506906:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569361152:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506914:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569360000:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506921:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569360512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535875.506929:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569361024:0@lo:400:kworker.0 00000100:00080000:3.0:1788535875.507091:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535875.507096:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535875.507098:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535875.507100:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535875.507243:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569359872 00000100:00100000:1.0:1788535875.507253:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569359872 00000100:00100000:1.0:1788535875.507434:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788535875.507442:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569359872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535875.507487:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569359872:12345-0@lo:400:kworker.0 Request processed in 47us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535875.507494:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788535875.508001:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569359872:0@lo:400:kworker.0 00010000:00010000:0.0:1788535875.757836:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535876.012371:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535876.012396:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569361664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535876.012466:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535876.012534:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569361536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535876.012559:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535876.012661:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569361664 00000100:00100000:1.0:1788535876.012663:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569361536 00000100:00100000:2.0:1788535876.012670:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569361664 00000100:00100000:1.0:1788535876.012670:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569361536 00000100:00100000:2.0:1788535876.012727:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788535876.012736:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788535876.012740:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569361664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535876.012751:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569361536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788535876.012774:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788535876.012775:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535876.015784:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569361664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3037us (3308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535876.015799:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788535876.016190:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569361536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3442us (3627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535876.016200:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788535876.024422:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf0a80 x1875415569361664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535876.024454:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569361664:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788535876.024471:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e018000 x1875415569361536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535876.024485:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569361536:0@lo:13:osp-pre-1-1.0 00000020:00000004:2.0:1788535876.153571:0:12615:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788535876.153811:0:12615:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788535876.784280:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535877.036687:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569361792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535877.036753:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535877.036881:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569361792 00000100:00100000:3.0:1788535877.036889:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569361792 00000100:00100000:3.0:1788535877.036944:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788535877.036953:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005c1af7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569361792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535877.036982:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535877.037021:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005c1af7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569361792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535877.037028:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788535877.037294:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535877.037324:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005842e0a80 x1875415569361792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535877.037344:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569361792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535877.046733:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569361920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535877.046797:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535877.046884:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569361920 00000100:00100000:2.0:1788535877.046891:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569361920 00000100:00100000:2.0:1788535877.046944:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788535877.046952:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569361920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788535877.046972:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535877.047012:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569361920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535877.047019:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788535877.047054:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048816bb80 x1875415569361920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535877.047071:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569361920:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788535877.047118:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535877.550792:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535877.550810:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569362048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535877.550873:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535877.551339:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569362048 00000100:00100000:3.0:1788535877.551348:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569362048 00000100:00100000:3.0:1788535877.551442:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788535877.551464:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569362048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788535877.551496:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535877.551562:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569362048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535877.551568:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788535877.551642:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569362048:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535877.806547:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535878.060765:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569362176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535878.060835:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535878.061309:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569362176 00000100:00100000:1.0:1788535878.061318:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569362176 00000100:00100000:1.0:1788535878.061372:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788535878.061381:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569362176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788535878.061414:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788535878.061516:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569362176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535878.061524:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788535878.069355:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569362176:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788535878.095985:0:12713:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788535878.096584:0:12713:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788535878.524461:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535878.525353:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535878.525383:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535878.525643:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548313088 00000100:00100000:0.0:1788535878.525652:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548313088 00000100:00100000:0.0:1788535878.525779:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 306 00000100:00100000:0.0:1788535878.525794:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548313088:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535878.525856:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548313088:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 63us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535878.525863:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 306 00000100:00100000:1.0:1788535878.530413:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535878.532002:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535878.532030:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535878.532057:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535878.532323:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548313216 00000100:00100000:3.0:1788535878.532333:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548313216 00000100:00100000:3.0:1788535878.532478:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548313344 00000100:00100000:3.0:1788535878.532482:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548313344 00000100:00100000:3.0:1788535878.532499:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548313600 00000100:00100000:3.0:1788535878.532501:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548313600 00000100:00100000:3.0:1788535878.532514:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548313472 00000100:00100000:3.0:1788535878.532516:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548313472 00000100:00100000:3.0:1788535878.532530:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:3.0:1788535878.532541:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548313216:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535878.532615:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548313216:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (8164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535878.532623:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:3.0:1788535878.532642:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:3.0:1788535878.532649:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548313344:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535878.532672:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548313344:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (7288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535878.532677:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:3.0:1788535878.532688:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:3.0:1788535878.532694:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548313600:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535878.532714:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548313600:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 20us (2312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535878.532730:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:3.0:1788535878.532743:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:3.0:1788535878.532748:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548313472:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535878.532774:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548313472:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535878.532780:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00080000:1.0:1788535878.533372:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535878.533377:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535878.533816:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548313856 00000100:00100000:3.0:1788535878.533824:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548313856 00000100:00100000:3.0:1788535878.533867:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548313728 00000100:00100000:3.0:1788535878.533871:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548313728 00000100:00100000:3.0:1788535878.533896:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1788535878.533903:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548313856:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535878.533954:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548313856:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 51us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535878.533961:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1788535878.533976:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1788535878.533982:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548313728:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535878.534012:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548313728:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 31us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535878.534018:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00080000:3.0:1788535878.534038:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535878.534041:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788535878.831117:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788535879.796700:0:12810:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788535879.797044:0:12810:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788535879.852790:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535880.626772:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569362432:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.626834:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.626883:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569362944:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.626905:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.626929:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569363456:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.626952:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.626976:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788535880.626983:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569362304:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627010:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627029:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569362816:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627099:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627117:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569363328:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627179:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627199:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569363840:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627220:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627248:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569362560:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627270:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627303:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569363072:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627337:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627358:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569363584:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627392:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627411:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788535880.627417:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569362688:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627437:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627646:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569363200:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627669:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627686:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569363712:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627705:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535880.627736:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569362432 00000100:00100000:2.0:1788535880.627744:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569362432 00000100:00100000:2.0:1788535880.627778:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569362944 00000100:00100000:2.0:1788535880.627781:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569362944 00000100:00100000:2.0:1788535880.627802:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569363456 00000100:00100000:2.0:1788535880.627805:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569363456 00000100:00100000:2.0:1788535880.627814:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569363072 00000100:00100000:2.0:1788535880.627816:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569363072 00000100:00100000:2.0:1788535880.627824:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569363584 00000100:00100000:2.0:1788535880.627826:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569363584 00000100:00100000:2.0:1788535880.627834:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569362688 00000100:00100000:2.0:1788535880.627836:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569362688 00000100:00100000:2.0:1788535880.627848:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788535880.627854:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569362432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627906:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569362432:12345-0@lo:400:kworker.0 Request processed in 51us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.627913:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788535880.627929:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788535880.627935:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569362944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.627963:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569362944:12345-0@lo:400:kworker.0 Request processed in 28us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.627968:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788535880.627979:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788535880.627984:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569363456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628020:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569363456:12345-0@lo:400:kworker.0 Request processed in 36us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628026:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788535880.628037:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788535880.628043:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569363072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628071:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569363072:12345-0@lo:400:kworker.0 Request processed in 28us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628076:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788535880.628087:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788535880.628093:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569363584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628117:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569363584:12345-0@lo:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628134:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788535880.628167:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788535880.628175:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569362688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628203:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569362688:12345-0@lo:400:kworker.0 Request processed in 30us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628208:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788535880.628236:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569362304 00000100:00100000:2.0:1788535880.628240:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569362304 00000100:00100000:2.0:1788535880.628270:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788535880.628352:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569362304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628531:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569362304:12345-0@lo:400:kworker.0 Request processed in 254us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628538:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788535880.628581:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569362816 00000100:00100000:2.0:1788535880.628585:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569362816 00000100:00100000:2.0:1788535880.628603:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569362560 00000100:00100000:2.0:1788535880.628606:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569362560 00000100:00100000:2.0:1788535880.628620:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788535880.628626:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569362816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628660:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569362816:12345-0@lo:400:kworker.0 Request processed in 35us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628666:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788535880.628679:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788535880.628685:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569362560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628712:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569362560:12345-0@lo:400:kworker.0 Request processed in 27us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628717:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788535880.628735:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569363328 00000100:00100000:2.0:1788535880.628739:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569363328 00000100:00100000:2.0:1788535880.628757:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569363840 00000100:00100000:2.0:1788535880.628760:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569363840 00000100:00100000:2.0:1788535880.628771:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569363200 00000100:00100000:2.0:1788535880.628774:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569363200 00000100:00100000:2.0:1788535880.628784:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569363712 00000100:00100000:2.0:1788535880.628787:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569363712 00000100:00100000:2.0:1788535880.628799:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788535880.628805:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569363328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628832:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569363328:12345-0@lo:400:kworker.0 Request processed in 28us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628838:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788535880.628848:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788535880.628854:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569363840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628890:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569363840:12345-0@lo:400:kworker.0 Request processed in 37us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628897:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788535880.628908:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788535880.628914:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569363200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628939:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569363200:12345-0@lo:400:kworker.0 Request processed in 25us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628944:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788535880.628953:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788535880.628957:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569363712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.628978:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569363712:12345-0@lo:400:kworker.0 Request processed in 21us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535880.628983:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788535880.629015:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535880.629019:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535880.629022:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535880.629024:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535880.629057:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569362688:0@lo:400:kworker.0 00010000:00080000:2.0:1788535880.629070:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048816b480 x1875415569363200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535880.629080:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569363200:0@lo:400:kworker.0 00010000:00080000:2.0:1788535880.629090:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488081180 x1875415569363712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535880.629098:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569363712:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.629109:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569362560:0@lo:400:kworker.0 00010000:00080000:2.0:1788535880.629143:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488169c00 x1875415569363072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535880.629177:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569363072:0@lo:400:kworker.0 00010000:00080000:2.0:1788535880.629190:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488083100 x1875415569363584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535880.629197:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569363584:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.629241:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569362304:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.629252:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569362816:0@lo:400:kworker.0 00010000:00080000:2.0:1788535880.629262:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488168380 x1875415569363328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535880.629270:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569363328:0@lo:400:kworker.0 00010000:00080000:2.0:1788535880.629290:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488083800 x1875415569363840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535880.629298:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569363840:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.629310:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569362432:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.629320:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569362944:0@lo:400:kworker.0 00000100:00100000:2.0:1788535880.629329:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569363456:0@lo:400:kworker.0 00010000:00010000:0.0:1788535880.877398:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535881.135339:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569363968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535881.135448:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535881.135755:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535881.135767:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569364096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535881.135806:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535881.135852:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569363968 00000100:00100000:2.0:1788535881.135859:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569363968 00000100:00100000:2.0:1788535881.135898:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569364096 00000100:00100000:2.0:1788535881.135901:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569364096 00000100:00100000:2.0:1788535881.135916:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788535881.135924:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569363968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788535881.135953:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535881.135966:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788535881.135980:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569364096:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535881.136000:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569363968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (551us total) trans 0 rc 0/0 00002000:00000024:3.0:1788535881.136003:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535881.136012:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788535881.136057:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569364096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (250us total) trans 0 rc 0/0 00010000:00080000:2.0:1788535881.136059:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e018a80 x1875415569363968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535881.136071:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788535881.136086:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569363968:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788535881.136126:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f1500 x1875415569364096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535881.136143:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569364096:0@lo:13:osp-pre-1-0.0 00000020:00000004:1.0:1788535881.601108:0:12908:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788535881.601794:0:12908:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788535881.904405:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535882.156539:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569364224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535882.156616:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535882.156743:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569364224 00000100:00100000:1.0:1788535882.156753:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569364224 00000100:00100000:1.0:1788535882.156818:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788535882.156829:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569364224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535882.156903:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535882.157029:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535882.157044:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569364352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535882.157076:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535882.161514:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569364352 00000100:00100000:3.0:1788535882.161532:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569364352 00000100:00100000:3.0:1788535882.161586:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788535882.161596:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569364352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788535882.161623:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535882.161705:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569364352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (4627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535882.161713:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788535882.161761:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879f1f80 x1875415569364352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535882.161781:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569364352:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788535882.162707:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535882.164539:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569364224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7704us (7915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535882.164553:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788535882.165309:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005842e0e00 x1875415569364224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535882.165332:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569364224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535882.668284:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569364480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788535882.668392:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535882.668466:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569364480 00000100:00100000:2.0:1788535882.668474:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569364480 00000100:00100000:2.0:1788535882.668535:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788535882.668544:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569364480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788535882.668578:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788535882.668645:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569364480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535882.668652:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788535882.668702:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569364480:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788535882.924746:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535883.183309:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569364608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535883.183374:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535883.183443:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569364608 00000100:00100000:2.0:1788535883.183450:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569364608 00000100:00100000:2.0:1788535883.183490:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788535883.183499:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569364608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788535883.183530:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788535883.183638:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569364608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535883.183645:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788535883.183688:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569364608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535883.642253:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535883.642383:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548313984 00000100:00100000:0.0:1788535883.642392:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548313984 00000100:00100000:0.0:1788535883.642446:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 308 00000100:00100000:0.0:1788535883.642456:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548313984:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535883.642521:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548313984:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 66us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535883.642528:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 308 00000100:00100000:2.0:1788535883.644748:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535883.644799:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535883.644964:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548314112 00000100:00100000:2.0:1788535883.644973:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548314112 00000100:00100000:2.0:1788535883.645286:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548314240 00000100:00100000:2.0:1788535883.645291:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548314240 00000100:00100000:2.0:1788535883.645316:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:2.0:1788535883.645326:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548314112:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:3.0:1788535883.645391:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535883.645395:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535883.645423:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:3.0:1788535883.645432:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548314240:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535883.645491:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548314240:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 61us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535883.645515:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:2.0:1788535883.645691:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548314112:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 366us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535883.645698:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:1.0:1788535883.646927:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535883.646996:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535883.647091:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535883.647139:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535883.647237:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548314368 00000100:00100000:2.0:1788535883.647245:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548314368 00000100:00100000:2.0:1788535883.647299:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548314496 00000100:00100000:2.0:1788535883.647314:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548314496 00000100:00100000:2.0:1788535883.647338:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:2.0:1788535883.647347:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548314368:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535883.647401:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548314368:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 56us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535883.647409:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:2.0:1788535883.647424:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:2.0:1788535883.647431:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548314496:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535883.647448:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548314496:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 19us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535883.647452:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:2.0:1788535883.647465:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548314624 00000100:00100000:2.0:1788535883.647467:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548314624 00000100:00100000:2.0:1788535883.647488:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548314752 00000100:00100000:2.0:1788535883.647490:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548314752 00000100:00100000:2.0:1788535883.647500:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788535883.647504:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2398:x1875415548314624:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1788535883.647519:0:8447:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc568 00000100:00080000:2.0:1788535883.647526:0:8447:0:(import.c:65:import_set_state_nolock()) ffff90059fb0e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788535883.647560:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788535883.647648:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+2:2398:x1875415548314624:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 143us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535883.647652:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788535883.647662:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788535883.647666:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2398:x1875415548314752:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1788535883.647680:0:8447:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc56f 00000100:00080000:2.0:1788535883.647684:0:8447:0:(import.c:65:import_set_state_nolock()) ffff90059fb09800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788535883.647699:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1788535883.647712:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535883.647749:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+2:2398:x1875415548314752:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 83us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535883.647753:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00010000:00010000:2.0:1788535883.647768:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788535883.648132:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535883.648136:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535883.648139:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535883.648142:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788535883.949689:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535884.973016:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535885.741417:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569364864:0@lo:400:kworker.0 00000100:00100000:3.0:1788535885.741484:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535885.741563:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569364864 00000100:00100000:3.0:1788535885.741571:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569364864 00000100:00100000:3.0:1788535885.741612:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788535885.741621:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569364864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535885.741667:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569364864:12345-0@lo:400:kworker.0 Request processed in 47us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535885.741675:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788535885.741718:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569364864:0@lo:400:kworker.0 00000100:00100000:3.0:1788535885.741755:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569364992:0@lo:400:kworker.0 00000100:00100000:3.0:1788535885.741782:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535885.741813:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569364992 00000100:00100000:3.0:1788535885.741816:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569364992 00000100:00100000:3.0:1788535885.741841:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788535885.741847:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569364992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535885.741886:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569364992:12345-0@lo:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535885.741893:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788535885.741917:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569364992:0@lo:400:kworker.0 00000100:00100000:3.0:1788535885.741960:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569365376:0@lo:400:kworker.0 00000100:00100000:3.0:1788535885.742013:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535885.742060:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569365376 00000100:00100000:3.0:1788535885.742064:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569365376 00000100:00100000:3.0:1788535885.742108:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788535885.742115:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569365376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535885.742177:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569365376:12345-0@lo:400:kworker.0 Request processed in 62us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535885.742183:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788535885.742377:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569364736:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.742413:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.742440:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569365248:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.742471:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.742490:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535885.742496:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569365120:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.742517:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.742545:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569365248 00000100:00100000:0.0:1788535885.742549:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569365248 00000100:00100000:0.0:1788535885.742570:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788535885.742576:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569365248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.742612:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569365248:12345-0@lo:400:kworker.0 Request processed in 36us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.742618:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788535885.742635:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569364736 00000100:00100000:0.0:1788535885.742638:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569364736 00000100:00100000:0.0:1788535885.742660:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788535885.742666:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569364736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.742691:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569364736:12345-0@lo:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.742696:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788535885.742716:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569365120 00000100:00100000:0.0:1788535885.742719:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569365120 00000100:00100000:0.0:1788535885.742739:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788535885.742744:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569365120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.742769:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569365120:12345-0@lo:400:kworker.0 Request processed in 24us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.742774:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788535885.742802:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569365120:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.742819:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569364736:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.742828:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569365248:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.747098:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569365504:0@lo:400:kworker.0 00000100:00100000:2.0:1788535885.749127:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569365376:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.749951:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.750053:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569365632:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.750081:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.750136:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569365632 00000100:00100000:0.0:1788535885.750142:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569365632 00000100:00100000:0.0:1788535885.750217:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788535885.750228:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569365632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.750278:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569365632:12345-0@lo:400:kworker.0 Request processed in 53us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.750285:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1788535885.750333:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf2a00 x1875415569365632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535885.750345:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569365632:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.750384:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535885.750390:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569365760:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.750413:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.750437:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569365760 00000100:00100000:0.0:1788535885.750441:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569365760 00000100:00100000:0.0:1788535885.750468:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788535885.750474:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569365760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.750506:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569365760:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.750523:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788535885.750552:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005842e2d80 x1875415569365760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535885.750561:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569365760:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.750594:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788535885.750600:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569365888:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.750626:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.750650:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569365504 00000100:00100000:0.0:1788535885.750654:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569365504 00000100:00100000:0.0:1788535885.750678:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569365888 00000100:00100000:0.0:1788535885.750681:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569365888 00000100:00100000:0.0:1788535885.750702:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788535885.750708:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569365504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.750740:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569365504:12345-0@lo:400:kworker.0 Request processed in 32us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.750745:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788535885.750756:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788535885.750762:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569365888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.751051:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569365888:12345-0@lo:400:kworker.0 Request processed in 289us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.751058:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788535885.751098:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005842e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569365888:0@lo:400:kworker.0 00010000:00080000:0.0:1788535885.751383:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3800 x1875415569365504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535885.751395:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569365504:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.751459:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569366016:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.751490:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.751530:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569366144:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.751552:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.751576:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569366144 00000100:00100000:0.0:1788535885.751580:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569366144 00000100:00100000:0.0:1788535885.751605:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788535885.751612:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569366144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.751649:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569366144:12345-0@lo:400:kworker.0 Request processed in 38us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.751655:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788535885.751679:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ad500 x1875415569366144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535885.751689:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569366144:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.751717:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535885.751723:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569366272:0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.751742:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535885.751763:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569366272 00000100:00100000:0.0:1788535885.751767:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569366272 00000100:00080000:3.0:1788535885.752324:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535885.752330:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535885.752333:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535885.752335:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535885.753429:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788535885.753870:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569366272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535885.754008:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569366272:12345-0@lo:400:kworker.0 Request processed in 149us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535885.754017:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788535885.754318:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569366016 00000100:00100000:2.0:1788535885.754327:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569366016 00000100:00100000:2.0:1788535885.754368:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788535885.754375:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569366016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535885.754418:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569366016:12345-0@lo:400:kworker.0 Request processed in 43us (2927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535885.754424:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00080000:0.0:1788535885.755515:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3800 x1875415569366016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535885.755549:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569366016:0@lo:400:kworker.0 00000100:00080000:0.0:1788535885.755582:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788535885.764427:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ad500 x1875415569366272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535885.764446:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569366272:0@lo:400:kworker.0 00000001:02000400:3.0:1788535885.979805:0:13052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788535886.008588:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535886.252677:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569366400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535886.252748:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535886.255347:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569366400 00000100:00100000:3.0:1788535886.255361:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569366400 00000100:00100000:3.0:1788535886.255420:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788535886.255431:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569366400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535886.255462:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535886.255540:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569366400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535886.255546:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788535886.255593:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e018a80 x1875415569366400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535886.255613:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569366400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535886.256270:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569366528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535886.256322:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535886.260240:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569366528 00000100:00100000:0.0:1788535886.260255:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569366528 00000100:00100000:0.0:1788535886.260541:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788535886.260551:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569366528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535886.260577:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535886.260660:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569366528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (4336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535886.260667:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788535886.268769:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9005894ac000 x1875415569366528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535886.268797:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569366528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788535887.022633:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535887.276321:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569366656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535887.276386:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535887.276437:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569366656 00000100:00100000:2.0:1788535887.276445:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569366656 00000100:00080000:3.0:1788535887.276477:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535887.276515:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788535887.276526:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569366656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788535887.276555:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535887.276602:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569366656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535887.276616:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788535887.277021:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488081180 x1875415569366656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535887.277043:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569366656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535887.283310:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535887.283329:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569366784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535887.283391:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535887.283446:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569366784 00000100:00100000:3.0:1788535887.283452:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569366784 00000100:00100000:3.0:1788535887.283497:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788535887.283505:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569366784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535887.283524:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535887.283559:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569366784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535887.283566:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788535887.283583:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788535887.283606:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487a83b80 x1875415569366784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535887.283622:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569366784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535887.793056:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569366912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535887.793131:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535887.802727:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569366912 00000100:00100000:1.0:1788535887.802741:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569366912 00000100:00100000:1.0:1788535887.803210:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788535887.803221:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569366912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788535887.803254:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788535887.803340:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569366912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (10208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535887.803347:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788535887.803430:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569366912:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788535888.044326:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535888.301534:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569367040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535888.301595:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535888.305380:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569367040 00000100:00100000:3.0:1788535888.305396:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569367040 00000100:00100000:3.0:1788535888.305453:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788535888.305469:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569367040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535888.305501:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788535888.305576:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569367040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535888.305583:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788535888.305636:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569367040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535888.762255:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535888.762300:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535888.762569:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548314880 00000100:00100000:2.0:1788535888.762578:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548314880 00000100:00100000:2.0:1788535888.762632:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 310 00000100:00100000:2.0:1788535888.762641:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548314880:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535888.762711:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548314880:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535888.762719:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 310 00000100:00100000:0.0:1788535888.763180:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548315136 00000100:00100000:0.0:1788535888.763185:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548315136 00000100:00100000:0.0:1788535888.763240:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:0.0:1788535888.763249:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548315136:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535888.763281:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548315136:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535888.763288:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00080000:2.0:1788535888.763380:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535888.767283:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535888.767323:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535888.767352:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535888.767393:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548315392 00000100:00100000:3.0:1788535888.767403:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548315392 00000100:00100000:3.0:1788535888.767464:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548315008 00000100:00100000:0.0:1788535888.767464:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548315264 00000100:00100000:3.0:1788535888.767468:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548315008 00000100:00100000:0.0:1788535888.767468:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548315264 00000100:00100000:3.0:1788535888.767489:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:3.0:1788535888.767497:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548315392:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535888.767511:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:0.0:1788535888.767516:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548315008:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535888.767592:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:1.0:1788535888.767601:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548315264:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:2.0:1788535888.767659:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535888.767663:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535888.767768:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548315392:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 270us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535888.767768:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548315008:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 249us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535888.767776:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:1.0:1788535888.770468:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548315264:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 2857us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535888.773462:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:1.0:1788535888.773475:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00010000:00010000:1.0:1788535889.069891:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788535889.328580:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000020:00000080:0.0:1788535889.328591:0:8441:0:(genops.c:885:class_export_put()) final put ffff90059fb0a800/8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000001:00100000:2.0:1788535889.328675:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000020:00000080:1.0:1788535889.328676:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90059fb0a800/8d9ac97c-7faa-47b0-a267-eea08d7bbce2 for lustre-OST0000 00000020:00000080:2.0:1788535889.328681:0:9525:0:(genops.c:885:class_export_put()) final put ffff90059fb0a000/8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000020:00000080:1.0:1788535889.329876:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90059fb0a000/8d9ac97c-7faa-47b0-a267-eea08d7bbce2 for lustre-OST0001 00000020:00000080:1.0:1788535889.329906:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90059fb0e800 for lustre-OST0000 00000020:00000080:1.0:1788535889.329912:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90059fb09800 for lustre-OST0001 00000020:00000080:1.0:1788535889.380682:0:13200:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0487a450 20000000:00000080:1.0:1788535889.380698:0:13200:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9004880dcc00 uarg=0000000000000000 20000000:01000000:1.0:1788535889.380734:0:13200:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788535889.380739:0:13200:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788535889.380744:0:13200:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788535889.383723:0:13201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788535889.383887:0:13200:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788535889.392345:0:13200:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788535889.392373:0:13200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392390:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc506 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392399:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc514 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392418:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc522 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392424:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc530 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392434:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655275 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392441:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552b4 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392449:0:13200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392498:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552b4 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392513:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552b4 expref: 12 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.392536:0:13200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367168:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535889.392663:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655275 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392672:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655275 expref: 12 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.392680:0:13200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367296:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535889.392714:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc530 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392722:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc530 expref: 23 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.392731:0:13200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367424:0@lo:104: 00000100:00100000:2.0:1788535889.392764:0:13200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788535889.392803:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc522 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392811:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc522 expref: 23 pid: 6529 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.392819:0:13200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367552:0@lo:104: 00000100:00100000:2.0:1788535889.392837:0:13200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788535889.392855:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc514 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392863:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc514 expref: 23 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.392871:0:13200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367680:0@lo:104: 00000100:00100000:2.0:1788535889.392888:0:13200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788535889.392901:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc506 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.392909:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc506 expref: 23 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.392927:0:13200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367808:0@lo:104: 00000100:00100000:2.0:1788535889.392944:0:13200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535889.392952:0:13200:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105240 going to sleep for 11 seconds 00000100:00100000:1.0:1788535889.393984:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569367424 00000100:00100000:1.0:1788535889.393992:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569367424 00000100:00100000:1.0:1788535889.394130:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569367552 00000100:00100000:1.0:1788535889.394134:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569367552 00000100:00100000:1.0:1788535889.394168:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569367680 00000100:00100000:1.0:1788535889.394171:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569367680 00000100:00100000:1.0:1788535889.394178:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569367808 00000100:00100000:1.0:1788535889.394180:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569367808 00000100:00100000:1.0:1788535889.394200:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788535889.394208:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+6:13200:x1875415569367424:12345-0@lo:104: 00010000:00010000:1.0:1788535889.394221:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394277:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788535889.394283:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+6:13200:x1875415569367424:12345-0@lo:104: Request processed in 76us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535889.394289:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788535889.394304:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788535889.394309:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+5:13200:x1875415569367552:12345-0@lo:104: 00010000:00010000:1.0:1788535889.394316:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394355:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788535889.394360:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+5:13200:x1875415569367552:12345-0@lo:104: Request processed in 51us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535889.394365:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788535889.394376:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788535889.394381:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:13200:x1875415569367680:12345-0@lo:104: 00010000:00010000:1.0:1788535889.394388:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394412:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788535889.394417:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+4:13200:x1875415569367680:12345-0@lo:104: Request processed in 37us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535889.394422:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788535889.394431:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788535889.394436:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+3:13200:x1875415569367808:12345-0@lo:104: 00010000:00010000:1.0:1788535889.394442:0:6518:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394462:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788535889.394467:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:89006101-b582-4041-a87b-c8866dc8e13c+3:13200:x1875415569367808:12345-0@lo:104: Request processed in 31us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535889.394472:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788535889.394493:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788535889.394498:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394514:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e441c00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535889.394518:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394697:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535889.394706:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535889.394712:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535889.394742:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394748:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535889.394766:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394822:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e441c00/0xe79af2f39bbdc530 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc537 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394833:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788535889.394837:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394842:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51000 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535889.394845:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394861:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535889.394867:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535889.394873:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535889.394886:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394892:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535889.394898:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394905:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058af51000/0xe79af2f39bbdc522 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc529 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394914:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788535889.394917:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394923:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50400 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535889.394925:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394932:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535889.394938:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535889.394948:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535889.394958:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394964:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535889.394976:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394983:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc514 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc51b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394991:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535889.394994:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.394999:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e440c00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535889.395002:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.395009:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535889.395015:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535889.395019:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788535889.395028:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.395032:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535889.395042:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.395048:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e440c00/0xe79af2f39bbdc506 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc50d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.395072:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535889.395074:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535889.395075:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535889.395082:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535889.395855:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535889.395872:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569367936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535889.395922:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535889.395969:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535889.395975:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569368064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535889.395992:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535889.396015:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569368320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535889.396034:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535889.396049:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535889.396054:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569368192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535889.396097:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535889.396266:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569367936 00000100:00100000:3.0:1788535889.396272:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569367936 00010000:00010000:3.0:1788535889.396298:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc530 expref: 24 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535889.396315:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569368064 00000100:00100000:3.0:1788535889.396318:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569368064 00010000:00010000:3.0:1788535889.396326:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc522 expref: 25 pid: 6529 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535889.396334:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569368320 00000100:00100000:3.0:1788535889.396336:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569368320 00010000:00010000:3.0:1788535889.396344:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc506 expref: 26 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535889.396352:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569368192 00000100:00100000:3.0:1788535889.396354:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569368192 00010000:00010000:3.0:1788535889.396361:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc514 expref: 27 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535889.396372:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788535889.396379:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+27:3662:x1875415569367936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788535889.396390:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535889.396394:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc530 expref: 27 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535889.396404:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc530 expref: 27 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535889.396421:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535889.396455:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+27:3662:x1875415569367936:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535889.396462:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788535889.396477:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788535889.396482:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+26:3662:x1875415569368064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788535889.396488:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535889.396492:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc522 expref: 26 pid: 6529 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535889.396501:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc522 expref: 26 pid: 6529 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535889.396510:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535889.396527:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+26:3662:x1875415569368064:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535889.396532:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788535889.396541:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788535889.396547:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+25:3661:x1875415569368320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788535889.396553:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535889.396556:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc506 expref: 25 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535889.396565:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc506 expref: 25 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535889.396573:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535889.396592:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+25:3661:x1875415569368320:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535889.396597:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788535889.396613:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788535889.396619:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569368192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788535889.396625:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535889.396630:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc514 expref: 24 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535889.396637:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc514 expref: 24 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535889.396646:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535889.396664:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569368192:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535889.396669:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788535889.396702:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569368192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535889.396709:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569368320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535889.396729:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569368064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535889.396735:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569367936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535889.397557:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e440400/0xe79af2f39bbdc537 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc530 expref: 23 pid: 6528 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.397572:0:13200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367424:0@lo:104: 00010000:00010000:2.0:1788535889.397582:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc529 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc522 expref: 22 pid: 6529 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.397588:0:13200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367552:0@lo:104: 00010000:00010000:2.0:1788535889.397597:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc51b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc514 expref: 21 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.397604:0:13200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367680:0@lo:104: 00010000:00010000:2.0:1788535889.397612:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc50d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc506 expref: 20 pid: 6526 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.397619:0:13200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367808:0@lo:104: 00000100:00100000:1.0:1788535889.402253:0:13200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367168:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535889.402270:0:13200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1875415569367296:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535889.402305:0:13200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535889.402620:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535889.402670:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548315520 00000100:00100000:3.0:1788535889.402677:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548315520 00010000:00010000:3.0:1788535889.402710:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552b4 expref: 13 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535889.402750:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788535889.402759:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548315520:12345-192.168.203.13@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788535889.403141:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535889.403531:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548315648 00000100:00100000:2.0:1788535889.403536:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548315648 00010000:00010000:2.0:1788535889.403555:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655275 expref: 14 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535889.403583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1788535889.403590:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfaa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91b20ee6-59cb-4913-858f-bc518949fc4a+14:2401:x1875415548315648:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535889.403602:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535889.403619:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655275 expref: 14 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.403631:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655275 expref: 14 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.403648:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e460a00/0xe79af2f39bbdc53e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655275 expref: 14 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.403662:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535889.403700:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfaa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548315648:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 111us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535889.403707:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00010000:00010000:1.0:1788535889.410096:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535889.410119:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552b4 expref: 12 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410138:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552b4 expref: 12 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410184:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc553 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552b4 expref: 12 pid: 6526 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410207:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410222:0:10351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410257:0:10351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410265:0:10351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410271:0:10351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410278:0:10351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410284:0:10351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788535889.410289:0:10351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410297:0:10351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410317:0:10351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535889.410328:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535889.410374:0:13200:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535889.410374:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+11:2401:x1875415548315520:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 7615us (7753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535889.410391:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00010000:00010000:2.0:1788535889.410392:0:13200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535889.410402:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461e00/0xe79af2f39bbdc576 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535890.092467:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535890.860475:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569368576:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860545:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860604:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569369088:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860630:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860653:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569369600:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860674:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860699:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788535890.860705:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569368448:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860733:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860754:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569368960:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860776:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860794:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569369472:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860814:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860830:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569369984:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860849:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860887:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569368704:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860910:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860927:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569369216:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860945:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860961:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569369728:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.860980:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.860995:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788535890.861000:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569368832:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.861020:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.861029:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569369344:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.861046:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.861074:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569369856:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.861094:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535890.861125:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569368576 00000100:00100000:0.0:1788535890.861133:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569368576 00000100:00100000:0.0:1788535890.861938:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569369088 00000100:00100000:0.0:1788535890.861944:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569369088 00000100:00100000:0.0:1788535890.863262:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569369600 00000100:00100000:0.0:1788535890.863268:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569369600 00000100:00080000:2.0:1788535890.869376:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535890.870269:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569369472 00000100:00100000:1.0:1788535890.870279:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569369472 00000100:00100000:1.0:1788535890.870332:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569369984 00000100:00100000:1.0:1788535890.870341:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569369984 00000100:00100000:1.0:1788535890.870358:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569369344 00000100:00100000:1.0:1788535890.870360:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569369344 00000100:00100000:1.0:1788535890.870372:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569369856 00000100:00100000:1.0:1788535890.870374:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569369856 00000100:00100000:1.0:1788535890.870391:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788535890.870399:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569369472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.870484:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569369472:12345-0@lo:400:kworker.0 Request processed in 84us (9667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.870491:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788535890.870507:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788535890.870513:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569369984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.870541:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569369984:12345-0@lo:400:kworker.0 Request processed in 29us (9691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.870547:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788535890.870557:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788535890.870562:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569369344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.870594:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569369344:12345-0@lo:400:kworker.0 Request processed in 32us (9546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.870600:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788535890.870611:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788535890.870617:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569369856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.870644:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569369856:12345-0@lo:400:kworker.0 Request processed in 28us (9549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.870649:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788535890.870671:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569368960 00000100:00100000:1.0:1788535890.870675:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569368960 00000100:00100000:1.0:1788535890.870701:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569368704 00000100:00100000:1.0:1788535890.870705:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569368704 00000100:00100000:1.0:1788535890.870718:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788535890.870724:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569368960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.870756:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569368960:12345-0@lo:400:kworker.0 Request processed in 33us (9980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.870761:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788535890.870773:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788535890.870778:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569368704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.870805:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569368704:12345-0@lo:400:kworker.0 Request processed in 26us (9894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.870810:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788535890.870827:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569368448 00000100:00100000:1.0:1788535890.870830:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569368448 00000100:00100000:1.0:1788535890.870856:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788535890.870863:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:3663:x1875415569368448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.870895:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+20:3663:x1875415569368448:12345-0@lo:400:kworker.0 Request processed in 33us (10160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.870900:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788535890.870927:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569369216 00000100:00100000:1.0:1788535890.870931:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569369216 00000100:00100000:1.0:1788535890.870947:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569369728 00000100:00100000:1.0:1788535890.870949:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569369728 00000100:00100000:1.0:1788535890.870960:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569368832 00000100:00100000:1.0:1788535890.870962:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569368832 00000100:00100000:1.0:1788535890.870973:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788535890.870979:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569368576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.871011:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569368576:12345-0@lo:400:kworker.0 Request processed in 32us (10466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.871024:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788535890.871037:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788535890.871043:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569369088:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788535890.871247:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535890.871252:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535890.871261:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535890.871333:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569369088:12345-0@lo:400:kworker.0 Request processed in 289us (10702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.871340:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788535890.871353:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788535890.871359:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569369216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.871420:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569369216:12345-0@lo:400:kworker.0 Request processed in 61us (10473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.871426:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788535890.871438:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788535890.871444:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569369728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.871470:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569369728:12345-0@lo:400:kworker.0 Request processed in 26us (10489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.871475:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788535890.871486:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788535890.871492:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569368832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535890.871517:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569368832:12345-0@lo:400:kworker.0 Request processed in 26us (10497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535890.871523:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788535890.871799:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569368832:0@lo:400:kworker.0 00010000:00080000:0.0:1788535890.871815:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e754e00 x1875415569369344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535890.871825:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569369344:0@lo:400:kworker.0 00010000:00080000:0.0:1788535890.871835:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e757480 x1875415569369856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535890.871842:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569369856:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.871861:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569368704:0@lo:400:kworker.0 00010000:00080000:0.0:1788535890.871870:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e756300 x1875415569369216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535890.871877:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569369216:0@lo:400:kworker.0 00010000:00080000:0.0:1788535890.871886:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e755c00 x1875415569369728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535890.871894:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569369728:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.871931:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569368448:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.871941:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569368960:0@lo:400:kworker.0 00010000:00080000:0.0:1788535890.871950:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e754380 x1875415569369472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535890.871959:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569369472:0@lo:400:kworker.0 00010000:00080000:0.0:1788535890.871967:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e755180 x1875415569369984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535890.871974:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569369984:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.871983:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569368576:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.871992:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569369088:0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.872040:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788535890.872347:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569369600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535890.872397:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569369600:12345-0@lo:400:kworker.0 Request processed in 351us (11721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535890.872409:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788535890.872436:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569369600:0@lo:400:kworker.0 00010000:00010000:1.0:1788535891.116398:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788535891.181203:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788535891.181210:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900485fef800 from 7 10000000:01000000:1.0:1788535891.181215:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788535891.181268:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535891.181280:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535891.181291:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535891.181316:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487520a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788535891.181377:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535891.181425:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005831e6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788535891.181495:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569370112 00000100:00100000:3.0:1788535891.181503:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569370112 00000100:00100000:3.0:1788535891.181550:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788535891.181557:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569370112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535891.181570:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535891.181583:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc57d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.181605:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc57d expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.181616:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc57d expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.181623:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51400, rc 0) 00000100:00100000:3.0:1788535891.181671:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569370112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.181677:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788535891.181864:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487520a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535891.181879:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535891.181889:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535891.181960:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535891.181988:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535891.182006:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900591f97000 going to sleep for 11 seconds 00000100:00100000:3.0:1788535891.182069:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569370240 00000100:00100000:3.0:1788535891.182073:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569370240 00000100:00100000:3.0:1788535891.182104:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788535891.182111:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569370240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.182326:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569370240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.182333:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788535891.182398:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535891.182427:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535891.182476:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535891.182533:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900591f97000 going to sleep for 11 seconds 00000100:00100000:1.0:1788535891.184558:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569370368 00000100:00100000:1.0:1788535891.184569:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569370368 00000100:00100000:1.0:1788535891.184661:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788535891.184671:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569370368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788535891.184808:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569370368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (2330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535891.184815:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788535891.184908:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788535891.185589:0:13256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788535891.185652:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788535891.185673:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535891.185682:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.185693:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535891.185702:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788535891.185705:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005893a3800 from 7 10000000:01000000:3.0:1788535891.185707:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788535891.185736:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.185744:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.185753:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535891.185774:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.185811:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.190237:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900581658600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535891.190298:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569370496 00000100:00100000:2.0:1788535891.190306:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569370496 00000100:00100000:2.0:1788535891.190356:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788535891.190365:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569370496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535891.190380:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535891.190396:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc58b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535891.190422:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc58b expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535891.190433:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc58b expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535891.190442:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461200, rc 0) 00000100:00100000:2.0:1788535891.190514:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569370496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (4701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535891.190521:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788535891.194517:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535891.194544:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.194557:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535891.194651:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.194703:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.194747:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900581658600 going to sleep for 11 seconds 00000100:00100000:1.0:1788535891.196250:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569370624 00000100:00100000:1.0:1788535891.196261:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569370624 00000100:00100000:1.0:1788535891.196309:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788535891.196318:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569370624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788535891.196466:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569370624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535891.196473:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788535891.197186:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.197238:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.197285:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.197319:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff900581658600 going to sleep for 11 seconds 00000100:00100000:3.0:1788535891.197336:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569370752 00000100:00100000:3.0:1788535891.197340:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569370752 00000100:00100000:3.0:1788535891.197366:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788535891.197373:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569370752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.197478:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569370752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.197486:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788535891.197526:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788535891.198193:0:13257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788535891.198242:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788535891.198262:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535891.198271:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.198282:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535891.198291:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788535891.198302:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831a8000 from 7 10000000:01000000:3.0:1788535891.198304:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788535891.198330:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.198337:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.198345:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535891.198361:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.198393:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.198409:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058146ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535891.198425:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569370880 00000100:00100000:3.0:1788535891.198428:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569370880 00000100:00100000:3.0:1788535891.198448:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788535891.198454:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569370880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535891.198463:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535891.198474:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc599 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.198494:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc599 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.198505:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc599 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.198514:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51200, rc 0) 00000100:00100000:3.0:1788535891.198545:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569370880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.198557:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788535891.198591:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569370880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535891.198603:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.198611:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535891.198652:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.198678:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.198691:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005893f3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788535891.198701:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569371008 00000100:00100000:3.0:1788535891.198704:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569371008 00000100:00100000:3.0:1788535891.198719:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788535891.198725:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569371008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.198800:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569371008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.198807:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788535891.198835:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.198861:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.198897:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.198911:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005893f3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788535891.198921:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569371136 00000100:00100000:3.0:1788535891.198925:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569371136 00000100:00100000:3.0:1788535891.198942:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788535891.198954:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569371136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.199020:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569371136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.199027:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788535891.199078:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788535891.199780:0:13258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788535891.199827:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788535891.199843:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788535891.199851:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.199861:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788535891.199870:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788535891.199872:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831fb800 from 7 10000000:01000000:3.0:1788535891.199875:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788535891.199896:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.199904:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.199912:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535891.199929:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.199963:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.199990:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005893f3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788535891.200005:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569371264 00000100:00100000:3.0:1788535891.200010:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569371264 00000100:00100000:3.0:1788535891.200033:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788535891.200041:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569371264:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535891.202229:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535891.202329:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548315776 00000100:00100000:1.0:1788535891.202338:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548315776 00000100:00100000:1.0:1788535891.202398:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 322 00000100:00100000:1.0:1788535891.202408:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+11:6172:x1875415548315776:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535891.202421:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535891.202437:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b16552e5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535891.202476:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552e5 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535891.202489:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552e5 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535891.202499:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e441a00, rc 0) 00000100:00100000:1.0:1788535891.202552:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548315776:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 146us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535891.202559:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 322 00010000:00010000:3.0:1788535891.203422:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535891.203438:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc5a7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.204560:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc5a7 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.204577:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc5a7 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535891.204586:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51000, rc 0) 00000100:00100000:3.0:1788535891.204658:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569371264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4616us (4693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.204664:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788535891.205589:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535891.205610:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535891.205621:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535891.205697:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535891.205737:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535891.205773:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005831d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788535891.206257:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569371392 00000100:00100000:2.0:1788535891.206263:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569371392 00000100:00100000:2.0:1788535891.206300:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788535891.206306:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569371392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535891.206415:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569371392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535891.206422:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788535891.206527:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535891.206559:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535891.206599:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535891.206614:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005831d4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788535891.206629:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569371520 00000100:00100000:2.0:1788535891.206632:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569371520 00000100:00100000:2.0:1788535891.206656:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788535891.206663:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569371520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535891.206746:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569371520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535891.206753:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788535891.206790:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569371520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788535891.207848:0:13259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788535891.208632:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788535891.208660:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788535891.208670:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535891.208682:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535891.209293:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535891.210140:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548315904 00000100:00100000:3.0:1788535891.210232:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548315904 00000100:00100000:3.0:1788535891.210284:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 325 00000100:00100000:3.0:1788535891.210294:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548315904:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.210435:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548315904:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 143us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.210443:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 325 00000100:00100000:1.0:1788535891.212364:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535891.212428:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548316032 00000100:00100000:3.0:1788535891.212442:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548316032 00000100:00100000:3.0:1788535891.212583:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 326 00000100:00100000:3.0:1788535891.212593:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548316032:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.212709:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548316032:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 117us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.212716:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 326 00000100:00100000:1.0:1788535891.227662:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535891.229215:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548316160 00000100:00100000:2.0:1788535891.229228:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548316160 00000100:00100000:2.0:1788535891.229285:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 327 00000100:00100000:2.0:1788535891.229296:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548316160:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535891.229312:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535891.229330:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b16552ec expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535891.229358:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ec expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535891.229368:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ec expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535891.229376:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461800, rc 0) 00000100:00100000:2.0:1788535891.229439:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548316160:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 146us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535891.229446:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 327 00000100:00100000:1.0:1788535891.231757:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535891.231835:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548316288 00000100:00100000:3.0:1788535891.231845:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548316288 00000100:00100000:3.0:1788535891.231900:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 328 00000100:00100000:3.0:1788535891.231911:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548316288:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.232062:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548316288:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 151us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.232070:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 328 00000100:00100000:2.0:1788535891.236239:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535891.236331:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548316416 00000100:00100000:3.0:1788535891.236340:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548316416 00000100:00100000:3.0:1788535891.236394:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 329 00000100:00100000:3.0:1788535891.236404:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548316416:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535891.236541:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548316416:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 137us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.236549:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 329 00000100:00100000:3.0:1788535891.372320:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535891.372340:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569371648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535891.372401:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.372458:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569371648 00000100:00100000:3.0:1788535891.372465:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569371648 00000100:00100000:3.0:1788535891.372502:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788535891.372515:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569371648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535891.372540:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535891.372577:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569371648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.372583:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1788535891.372619:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb33100 x1875415569371648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535891.372634:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569371648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535891.372740:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569371776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535891.372767:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535891.372827:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569371776 00000100:00100000:3.0:1788535891.372830:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569371776 00000100:00100000:3.0:1788535891.372886:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788535891.372893:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569371776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535891.372901:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535891.372931:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569371776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535891.372936:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1788535891.374199:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488084e00 x1875415569371776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535891.374216:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569371776:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788535892.140918:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535892.396543:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535892.396565:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569371904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535892.396627:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535892.396723:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569371904 00000100:00100000:3.0:1788535892.396732:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569371904 00000100:00100000:3.0:1788535892.396793:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788535892.396803:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569371904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535892.396830:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535892.396897:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569371904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535892.396920:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788535892.396954:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788535892.397087:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488085f80 x1875415569371904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535892.397105:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569371904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535892.397362:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569372032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535892.397395:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535892.397431:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569372032 00000100:00100000:2.0:1788535892.397436:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569372032 00000100:00100000:2.0:1788535892.397469:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788535892.397478:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569372032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788535892.397491:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535892.397531:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569372032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535892.397537:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788535892.397553:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788535892.397679:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7ea00 x1875415569372032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535892.397769:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569372032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535892.912492:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535892.912513:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569372160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788535892.912605:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535892.912765:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569372160 00000100:00100000:1.0:1788535892.912773:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569372160 00000100:00100000:1.0:1788535892.912830:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788535892.912850:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569372160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788535892.912886:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788535892.913266:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569372160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 427us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535892.913275:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788535892.913321:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569372160:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788535892.996322:0:13397:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788535893.168393:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535893.420434:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535893.420465:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569372288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535893.420533:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535893.420613:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569372288 00000100:00100000:1.0:1788535893.420624:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569372288 00000100:00100000:1.0:1788535893.420676:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788535893.420686:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569372288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788535893.420719:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788535893.421971:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569372288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1281us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535893.421981:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788535893.422057:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569372288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535893.886262:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535893.886309:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535893.886338:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535893.886362:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535893.886385:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535893.886426:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548316800 00000100:00100000:3.0:1788535893.886437:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548316800 00000100:00100000:0.0:1788535893.886506:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548317056 00000100:00100000:3.0:1788535893.886509:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548316672 00000100:00100000:0.0:1788535893.886511:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548317056 00000100:00100000:3.0:1788535893.886514:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548316672 00000100:00100000:3.0:1788535893.886529:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548316928 00000100:00100000:3.0:1788535893.886531:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548316928 00000100:00100000:3.0:1788535893.886546:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:0.0:1788535893.886591:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00080000:1.0:1788535893.886597:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535893.886603:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535893.886603:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548316672:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535893.886664:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548316544 00000100:00100000:2.0:1788535893.886670:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548316544 00000100:00100000:0.0:1788535893.886680:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548316672:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 81us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535893.886687:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:0.0:1788535893.886707:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:2.0:1788535893.886711:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 330 00000100:00100000:0.0:1788535893.886716:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548316928:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535893.886725:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548316544:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535893.886757:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548316544:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535893.886764:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 330 00000100:00100000:0.0:1788535893.886770:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548316928:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 57us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535893.886776:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:0.0:1788535893.886791:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:3.0:1788535893.888528:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548316800:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535893.888603:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548316800:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 2048us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535893.888612:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:0.0:1788535893.890603:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548317056:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535893.890721:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548317056:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 3923us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535893.890741:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 182 00010000:00010000:0.0:1788535894.190041:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535895.212596:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535895.981497:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569372544:0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.981555:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569372416:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.981565:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535895.981612:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569372800:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.983898:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569373056:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.983954:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.983988:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569373568:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.984010:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.984049:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788535895.984056:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569372672:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.984084:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.984105:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569373184:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.985010:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.986272:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569373696:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.986322:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.986376:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569372544 00000100:00100000:1.0:1788535895.986383:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569372544 00000100:00100000:1.0:1788535895.986426:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569373056 00000100:00100000:1.0:1788535895.986430:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569373056 00000100:00100000:1.0:1788535895.986454:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569373568 00000100:00100000:1.0:1788535895.986457:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569373568 00000100:00100000:1.0:1788535895.986470:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569373184 00000100:00100000:1.0:1788535895.986473:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569373184 00000100:00100000:1.0:1788535895.986483:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569373696 00000100:00100000:1.0:1788535895.986485:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569373696 00000100:00100000:1.0:1788535895.986501:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788535895.986507:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569372544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.986561:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569372544:12345-0@lo:400:kworker.0 Request processed in 53us (4995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535895.986569:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788535895.986573:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.986585:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788535895.986591:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569373056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.986601:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788535895.986608:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569373568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.986620:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569373056:12345-0@lo:400:kworker.0 Request processed in 30us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535895.986626:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788535895.986635:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569373568:12345-0@lo:400:kworker.0 Request processed in 29us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535895.986637:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788535895.986642:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569373184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.986652:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788535895.986664:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788535895.986665:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569373184:12345-0@lo:400:kworker.0 Request processed in 24us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535895.986669:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569373696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.986680:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788535895.986693:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569373696:12345-0@lo:400:kworker.0 Request processed in 24us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535895.986698:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1788535895.986705:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535895.986709:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535895.987386:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569372672 00000100:00100000:3.0:1788535895.987392:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569372672 00000100:00100000:3.0:1788535895.987428:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788535895.987435:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569372672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.987478:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569372672:12345-0@lo:400:kworker.0 Request processed in 44us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535895.987484:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788535895.987588:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569372416 00000100:00100000:3.0:1788535895.987592:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569372416 00000100:00100000:3.0:1788535895.987620:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788535895.987627:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569372416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.987659:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569372416:12345-0@lo:400:kworker.0 Request processed in 33us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535895.987665:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788535895.987783:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569372416:0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.987794:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569372928:0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.987821:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535895.987843:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569372928 00000100:00100000:3.0:1788535895.987846:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569372928 00000100:00100000:3.0:1788535895.987875:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788535895.987881:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569372928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.987911:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569372928:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535895.987918:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788535895.987943:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569372928:0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.987950:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569373440:0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.987973:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535895.987994:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569373952:0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.988249:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535895.988273:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569373312:0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.988303:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569372800 00000100:00100000:0.0:1788535895.988306:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569372800 00000100:00100000:0.0:1788535895.988335:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788535895.988341:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569372800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.988377:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569372800:12345-0@lo:400:kworker.0 Request processed in 36us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535895.988383:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00010000:00080000:1.0:1788535895.988677:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487523b80 x1875415569373184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535895.988691:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569373184:0@lo:400:kworker.0 00010000:00080000:1.0:1788535895.988709:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048816bb80 x1875415569373696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535895.988717:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569373696:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.988729:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569372544:0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.988803:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535895.988864:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569373440 00000100:00100000:0.0:1788535895.988869:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569373440 00000100:00100000:0.0:1788535895.988901:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569373952 00000100:00100000:0.0:1788535895.988904:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569373952 00000100:00100000:0.0:1788535895.988923:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788535895.988930:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569373440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.989075:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569373056:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.989088:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569373568:0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.989090:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535895.989105:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569373824:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.989118:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569372672:0@lo:400:kworker.0 00000100:00100000:3.0:1788535895.989132:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535895.989162:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569373312 00000100:00100000:1.0:1788535895.989166:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569373312 00000100:00100000:3.0:1788535895.989167:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569372800:0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.989182:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569373824 00000100:00100000:1.0:1788535895.989185:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569373824 00000100:00100000:1.0:1788535895.989197:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788535895.989203:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569373952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.989247:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569373952:12345-0@lo:400:kworker.0 Request processed in 44us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535895.989253:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788535895.989270:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788535895.989285:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569373312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.989318:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569373312:12345-0@lo:400:kworker.0 Request processed in 34us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535895.989323:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788535895.989336:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788535895.989341:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569373824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535895.989369:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569373824:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535895.989374:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788535895.989389:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535895.989393:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788535895.989418:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487521180 x1875415569373312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535895.989428:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569373312:0@lo:400:kworker.0 00010000:00080000:3.0:1788535895.989440:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048816b100 x1875415569373824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535895.989448:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569373824:0@lo:400:kworker.0 00010000:00080000:3.0:1788535895.989470:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488169180 x1875415569373952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535895.989477:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569373952:0@lo:400:kworker.0 00000100:00100000:0.0:1788535895.997288:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569373440:12345-0@lo:400:kworker.0 Request processed in 8347us (9302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535895.997304:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788535896.001931:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487520700 x1875415569373440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535896.001950:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569373440:0@lo:400:kworker.0 00010000:00010000:3.0:1788535896.237779:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535896.493038:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569374080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535896.493182:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535896.493385:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569374080 00000100:00100000:3.0:1788535896.493393:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569374080 00000100:00100000:3.0:1788535896.493455:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788535896.493465:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569374080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535896.493492:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535896.493536:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569374080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535896.493542:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788535896.493718:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569374208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535896.493745:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535896.493833:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569374208 00000100:00100000:0.0:1788535896.493838:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569374208 00000100:00100000:0.0:1788535896.493869:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788535896.493875:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569374208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535896.493886:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535896.493917:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569374208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535896.493923:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788535896.494020:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488084000 x1875415569374208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535896.494039:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569374208:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788535896.494799:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb31f80 x1875415569374080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535896.494816:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569374080:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788535897.264434:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535897.521987:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569374336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535897.522063:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535897.522135:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569374336 00000100:00100000:0.0:1788535897.522142:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569374336 00000100:00100000:0.0:1788535897.522211:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788535897.522220:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569374336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788535897.522248:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535897.522289:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569374336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535897.522295:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788535897.522314:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788535897.522341:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488086d80 x1875415569374336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535897.522359:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569374336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535897.529480:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569374464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535897.529552:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535897.540485:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569374464 00000100:00100000:1.0:1788535897.540500:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569374464 00000100:00100000:2.0:1788535897.540755:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788535897.540765:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569374464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788535897.540791:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535897.540880:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569374464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (11327us total) trans 0 rc 0/0 00000100:00080000:1.0:1788535897.541027:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535897.541055:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1788535897.541113:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487a83b80 x1875415569374464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535897.541371:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569374464:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788535897.588549:0:13547:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 11:31:36 (1788535896) === 00000100:00100000:2.0:1788535897.863432:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535897.864967:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535897.868032:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548317184 00000100:00100000:0.0:1788535897.868048:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548317184 00000100:00100000:0.0:1788535897.868116:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788535897.868140:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548317184:12345-192.168.203.13@tcp:41:mkdir.0 00000004:00000024:0.0:1788535897.868763:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788535897.868850:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548317184:12345-192.168.203.13@tcp:41:mkdir.0 Request processed in 711us (3884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535897.868858:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00080000:2.0:1788535897.869930:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535897.883800:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548317312 00000100:00100000:0.0:1788535897.883813:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548317312 00000100:00100000:0.0:1788535897.883883:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1788535897.884109:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:10517:x1875415548317312:12345-192.168.203.13@tcp:700:mkdir.0 00000100:00100000:0.0:1788535897.884349:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:10517:x1875415548317312:12345-192.168.203.13@tcp:700:mkdir.0 Request processed in 456us (20926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535897.884357:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1788535897.895933:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535897.895973:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548317568 00000100:00100000:0.0:1788535897.896756:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548317568 00000100:00100000:0.0:1788535897.896812:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1788535897.896821:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+6:10517:x1875415548317568:12345-192.168.203.13@tcp:36:mkdir.0 00010000:00010000:0.0:1788535897.896872:0:10112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535897.896948:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc465 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655260 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.898311:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900487807a00) 00010000:00010000:0.0:1788535897.898332:0:10112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535897.898414:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.898429:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.898440:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.898481:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.898490:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.898497:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903727:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903751:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903764:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535897.903780:0:10112:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000091dc7d3c reply state 00000000672c654a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903803:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903811:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff900583670e00) 00010000:00010000:0.0:1788535897.903814:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788535897.903818:0:10112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788535897.903823:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788535897.903830:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903837:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903843:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903849:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535897.903853:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903860:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903869:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900583670a00) 00010000:00010000:0.0:1788535897.903871:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535897.903875:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903881:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc5c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535897.903916:0:10112:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000091dc7d3c reply state 00000000672c654a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903924:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535897.903931:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff900583670600) 00010000:00010000:0.0:1788535897.903933:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788535897.903935:0:10112:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788535897.913389:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+7:10517:x1875415548317568:12345-192.168.203.13@tcp:36:mkdir.0 Request processed in 16556us (17452us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788535897.913402:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788535897.927090:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535897.927132:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548317696 00000100:00100000:2.0:1788535897.927141:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548317696 00000100:00100000:2.0:1788535897.927210:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1788535897.927219:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:10519:x1875415548317696:12345-192.168.203.13@tcp:101:chmod.0 00010000:00010000:2.0:1788535897.927239:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535897.927261:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc5d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16552f3 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.927325:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc5df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.927339:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.927365:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535897.927407:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788535897.927411:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788535897.927444:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.927466:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc5d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552f3 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.927482:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc5df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552f3 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.927491:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5f00) 00010000:00010000:2.0:1788535897.927494:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535897.927497:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460600, rc 0) 00000100:00100000:2.0:1788535897.927546:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:10519:x1875415548317696:12345-192.168.203.13@tcp:101:chmod.0 Request processed in 327us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535897.927552:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1788535897.931380:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535897.931486:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548317952 00000100:00100000:2.0:1788535897.931495:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548317952 00000100:00100000:2.0:1788535897.931549:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788535897.931559:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+8:10519:x1875415548317952:12345-192.168.203.13@tcp:36:chmod.0 00010000:00010000:2.0:1788535897.931606:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535897.931629:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc5df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552f3 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.931663:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5f00) 00010000:00010000:2.0:1788535897.931867:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535897.931982:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.931996:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.932014:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535897.932406:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000047d6f366 reply state 00000000e4f7ec71 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.932419:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.932425:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5000) 00010000:00010000:2.0:1788535897.932428:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788535897.932431:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788535897.932437:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788535897.932510:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:10519:x1875415548317952:12345-192.168.203.13@tcp:36:chmod.0 Request processed in 951us (1136us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788535897.932518:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788535897.978267:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535897.978449:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548318080 00000100:00100000:1.0:1788535897.978460:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548318080 00000100:00100000:1.0:1788535897.978520:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1788535897.978530:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+9:10520:x1875415548318080:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:1.0:1788535897.978554:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535897.978576:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc5ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16552fa expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.978659:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440600/0xe79af2f39bbdc5f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.978685:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440600/0xe79af2f39bbdc5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.978699:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440600/0xe79af2f39bbdc5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535897.978742:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788535897.978746:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535897.978780:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440600/0xe79af2f39bbdc5f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.978806:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc5ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552fa expref: 11 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.978824:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440600/0xe79af2f39bbdc5f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552fa expref: 10 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.978833:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5000) 00010000:00010000:1.0:1788535897.978836:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535897.978841:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e440600, rc 0) 00000100:00100000:1.0:1788535897.978907:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+10:10520:x1875415548318080:12345-192.168.203.13@tcp:101:chown.0 Request processed in 379us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535897.978914:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1788535897.981978:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535897.982128:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548318208 00000100:00100000:2.0:1788535897.982137:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548318208 00000100:00100000:2.0:1788535897.982221:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1788535897.982231:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+10:10520:x1875415548318208:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:2.0:1788535897.982262:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535897.982281:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc5fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655301 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982342:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982355:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982365:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982376:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982383:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982389:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982458:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc610 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982466:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982473:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535897.982511:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788535897.982520:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788535897.982543:0:6533:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982555:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982562:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982569:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982574:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535897.982579:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982586:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982597:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5000) 00010000:00010000:2.0:1788535897.982600:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535897.982604:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982610:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982621:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982627:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982643:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982648:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535897.982651:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982657:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982682:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff900583670600) 00010000:00010000:2.0:1788535897.982685:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535897.982688:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982695:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc609 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982721:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc5fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655301 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982735:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc610 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655301 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.982742:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff900583670e00) 00010000:00010000:2.0:1788535897.982744:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535897.982747:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460a00, rc 0) 00000100:00100000:2.0:1788535897.982808:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+11:10520:x1875415548318208:12345-192.168.203.13@tcp:101:chown.0 Request processed in 579us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535897.982823:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788535897.989263:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535897.989376:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548318336 00000100:00100000:1.0:1788535897.989397:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548318336 00000100:00100000:1.0:1788535897.989458:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788535897.989469:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b9ef506c-5095-4495-a34a-e3b5845d008a+11:10520:x1875415548318336:12345-192.168.203.13@tcp:900:chown.0 00000100:00100000:1.0:1788535897.989558:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b9ef506c-5095-4495-a34a-e3b5845d008a+11:10520:x1875415548318336:12345-192.168.203.13@tcp:900:chown.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535897.989566:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1788535897.991936:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535897.992022:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548318592 00000100:00100000:2.0:1788535897.992031:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548318592 00000100:00100000:2.0:1788535897.992095:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788535897.992106:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+11:10520:x1875415548318592:12345-192.168.203.13@tcp:36:chown.0 00010000:00010000:2.0:1788535897.992190:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535897.992215:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc610 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655301 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.992233:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff900583670e00) 00010000:00010000:2.0:1788535897.992238:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535897.992260:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.992272:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.992282:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535897.997133:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1788535897.997369:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997383:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997390:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997396:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535897.997400:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997407:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997424:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff900583670600) 00010000:00010000:1.0:1788535897.997427:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535897.997432:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997439:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc5ca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997460:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997480:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997486:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997490:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535897.997493:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997498:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997506:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff900583670e00) 00010000:00010000:1.0:1788535897.997508:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535897.997511:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997651:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc5d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997667:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997673:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997679:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997684:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535897.997693:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997700:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997710:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5000) 00010000:00010000:1.0:1788535897.997713:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788535897.997716:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535897.997722:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc5e6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535897.998060:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000a4a5864b reply state 000000008ce668ab transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.998083:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535897.998090:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff900583670e00) 00010000:00010000:2.0:1788535897.998092:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788535897.998095:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788535897.998113:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788535897.998529:0:6534:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788535897.998548:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:10520:x1875415548318592:12345-192.168.203.13@tcp:36:chown.0 Request processed in 6440us (6618us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788535897.998557:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00010000:00010000:3.0:1788535897.998776:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535897.998785:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535897.998791:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535897.998803:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535897.998807:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535897.998814:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535897.998825:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff900583670e00) 00010000:00010000:3.0:1788535897.998827:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788535897.998831:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535897.998837:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc617 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535898.028443:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569374592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788535898.028508:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535898.028628:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569374592 00000100:00100000:3.0:1788535898.028637:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569374592 00000100:00100000:3.0:1788535898.028687:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788535898.028696:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569374592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788535898.028729:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535898.028786:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569374592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535898.028793:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788535898.029311:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569374592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788535898.044372:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535898.046131:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548318720 00000100:00100000:2.0:1788535898.046192:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548318720 00000100:00100000:2.0:1788535898.046267:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1788535898.046278:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:10521:x1875415548318720:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:2.0:1788535898.046304:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535898.046324:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc61e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655308 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788535898.052945:0:6535:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6570us 00010000:00010000:1.0:1788535898.063693:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063717:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063728:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063742:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063749:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063755:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063868:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441c00/0xe79af2f39bbdc633 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063880:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441c00/0xe79af2f39bbdc633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063887:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441c00/0xe79af2f39bbdc633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535898.063916:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788535898.063919:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535898.063954:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441c00/0xe79af2f39bbdc633 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063979:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063986:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.063992:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064006:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e440200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535898.064010:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064017:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064028:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5000) 00010000:00010000:1.0:1788535898.064031:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535898.064036:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064268:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064280:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064286:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064292:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064297:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e441400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535898.064300:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064305:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064313:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9005b7b03200) 00010000:00010000:1.0:1788535898.064316:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535898.064319:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064325:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc62c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064360:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc61e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655308 expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064373:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441c00/0xe79af2f39bbdc633 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655308 expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.064386:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9005b7b03d00) 00010000:00010000:1.0:1788535898.064389:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788535898.064391:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e441c00, rc 0) 00000100:00100000:1.0:1788535898.064496:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:10521:x1875415548318720:12345-192.168.203.13@tcp:101:touch.500 Request processed in 18219us (20133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535898.064504:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1788535898.067617:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535898.068592:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548318976 00000100:00100000:1.0:1788535898.068603:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548318976 00000100:00100000:1.0:1788535898.068664:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1788535898.068673:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+7:10521:x1875415548318976:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:1.0:1788535898.068691:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535898.068709:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441000/0xe79af2f39bbdc63a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165530f expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.068806:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.068819:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.068830:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.068890:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.068898:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.068920:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788535898.069579:0:10016:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788535898.069724:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc64f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069735:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc64f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069742:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc64f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069774:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069781:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069787:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069793:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e440c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535898.069797:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069804:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069815:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9005b7b03d00) 00010000:00010000:1.0:1788535898.069818:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535898.069828:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069834:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc641 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535898.069847:0:10016:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000088cc7a18 reply state 000000001e09d351 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069857:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069864:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x76b728a6 (ffff9005b7b03c00) 00010000:00010000:1.0:1788535898.069866:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788535898.069869:0:10016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788535898.069897:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441000/0xe79af2f39bbdc63a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165530f expref: 10 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069911:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc64f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165530f expref: 9 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.069919:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9005b7b03800) 00010000:00010000:1.0:1788535898.069921:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535898.069923:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e440400, rc 0) 00000100:00100000:1.0:1788535898.070034:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+10:10521:x1875415548318976:12345-192.168.203.13@tcp:101:touch.500 Request processed in 1362us (2428us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788535898.070041:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1788535898.073141:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535898.073271:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548319232 00000100:00100000:2.0:1788535898.073281:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548319232 00000100:00100000:2.0:1788535898.073334:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1788535898.073344:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+10:10521:x1875415548319232:12345-192.168.203.13@tcp:36:touch.500 00010000:00010000:2.0:1788535898.073392:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535898.073415:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc64f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165530f expref: 10 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.073432:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9005b7b03800) 00010000:00010000:2.0:1788535898.073441:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535898.073490:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.073513:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.073523:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535898.073616:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000b3fa3706 reply state 000000009d2d863c transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.073627:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.073633:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90058aeb5f00) 00010000:00010000:2.0:1788535898.073635:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788535898.073638:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788535898.073710:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+11:10521:x1875415548319232:12345-192.168.203.13@tcp:36:touch.500 Request processed in 368us (577us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788535898.073716:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1788535898.076455:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535898.076543:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548319360 00000100:00100000:1.0:1788535898.076553:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548319360 00000100:00100000:1.0:1788535898.076608:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:1.0:1788535898.076618:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+11:10521:x1875415548319360:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:1.0:1788535898.076650:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535898.076667:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441000/0xe79af2f39bbdc664 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655316 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.076718:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441000/0xe79af2f39bbdc664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655316 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.076732:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441000/0xe79af2f39bbdc664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655316 expref: 12 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.076755:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90058aeb5f00) 00010000:00010000:1.0:1788535898.076758:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788535898.076761:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e441000, rc 0) 00000100:00100000:1.0:1788535898.076822:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+12:10521:x1875415548319360:12345-192.168.203.13@tcp:101:touch.500 Request processed in 205us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535898.076829:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1788535898.079726:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535898.079808:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548319488 00000100:00100000:1.0:1788535898.079817:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548319488 00000100:00100000:1.0:1788535898.079862:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:1.0:1788535898.079954:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005c191c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1875415548319488:12345-192.168.203.13@tcp:8:touch.500 00010000:00080000:1.0:1788535898.079989:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:1.0:1788535898.080033:0:8446:0:(genops.c:1385:class_connect()) connect: client b9ef506c-5095-4495-a34a-e3b5845d008a, cookie 0xe79af2f39bbdc66b 00002000:00100000:1.0:1788535898.080053:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b9ef506c-5095-4495-a34a-e3b5845d008a/ffff900487a55000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788535898.080064:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788535898.080193:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788535898.080221:0:8446:0:(import.c:65:import_set_state_nolock()) ffff900487a53000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788535898.080303:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005c191c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2398:x1875415548319488:12345-192.168.203.13@tcp:8:touch.500 Request processed in 349us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535898.082468:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535898.082537:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548319616 00000100:00100000:3.0:1788535898.082546:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548319616 00000100:00080000:2.0:1788535898.082625:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788535898.082834:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1788535898.083661:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788535898.083674:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:0:x1875415548319616:12345-192.168.203.13@tcp:2:touch.500 00000001:00080000:1.0:1788535898.091634:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1788535898.091648:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000100:00100000:2.0:1788535898.103993:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:0:x1875415548319616:12345-192.168.203.13@tcp:2:touch.500 Request processed in 20312us (21521us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788535898.104017:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1788535898.110912:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535898.110978:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548319872 00000100:00100000:2.0:1788535898.110988:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548319872 00000100:00100000:2.0:1788535898.111055:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1788535898.111080:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+12:10521:x1875415548319872:12345-192.168.203.13@tcp:35:touch.500 00000100:00100000:0.0:1788535898.111666:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+13:10521:x1875415548319872:12345-192.168.203.13@tcp:35:touch.500 Request processed in 586us (760us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788535898.111676:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788535898.125760:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535898.126140:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548320000 00000100:00100000:1.0:1788535898.126297:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548320000 00000100:00100000:1.0:1788535898.126359:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788535898.126369:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+13:10522:x1875415548320000:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1788535898.126391:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535898.126410:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165531d expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.126469:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc679 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.126484:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.126495:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535898.126714:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788535898.126718:0:10016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535898.126817:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535898.126849:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165531d expref: 15 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535898.126878:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165531d expref: 14 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535898.126887:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9005b7b03d00) 00010000:00010000:0.0:1788535898.126906:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535898.126910:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e441400, rc 0) 00000100:00100000:0.0:1788535898.126975:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+14:10522:x1875415548320000:12345-192.168.203.13@tcp:101:rm.0 Request processed in 607us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535898.126982:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1788535898.156707:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535898.156932:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548320256 00000100:00100000:3.0:1788535898.156942:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548320256 00000100:00100000:3.0:1788535898.157017:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788535898.157028:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+14:10522:x1875415548320256:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:3.0:1788535898.157049:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535898.157068:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580031a00/0xe79af2f39bbdc680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655324 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535898.157283:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788535898.157433:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900580031a00/0xe79af2f39bbdc680 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655324 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535898.157448:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5000) 00010000:00010000:3.0:1788535898.157451:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535898.157456:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580031a00/0xe79af2f39bbdc680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655324 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535898.157470:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580031a00, rc 0) 00000100:00100000:3.0:1788535898.157531:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+15:10522:x1875415548320256:12345-192.168.203.13@tcp:101:rm.0 Request processed in 505us (833us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788535898.157538:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788535898.164968:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535898.170332:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548320384 00000100:00100000:0.0:1788535898.170350:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548320384 00000100:00100000:0.0:1788535898.170480:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1788535898.170492:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+15:10522:x1875415548320384:12345-192.168.203.13@tcp:37:rm.0 00000100:00100000:3.0:1788535898.191949:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+15:10522:x1875415548320384:12345-192.168.203.13@tcp:37:rm.0 Request processed in 21449us (26980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535898.191964:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788535898.206137:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535898.206306:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548320640 00000100:00100000:3.0:1788535898.206330:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548320640 00000100:00100000:3.0:1788535898.206436:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788535898.206447:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf16850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+15:10522:x1875415548320640:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:3.0:1788535898.206675:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf16850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+16:10522:x1875415548320640:12345-192.168.203.13@tcp:35:rm.0 Request processed in 229us (548us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788535898.206684:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1788535898.212089:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535898.212195:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548320896 00000100:00100000:3.0:1788535898.212205:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548320896 00000100:00100000:3.0:1788535898.212266:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1788535898.212277:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+16:10522:x1875415548320896:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:3.0:1788535898.212301:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535898.212319:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580031a00/0xe79af2f39bbdc68e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165532b expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535898.212417:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc695 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535898.212433:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc695 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535898.212445:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc695 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535898.212455:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788535898.212596:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580031a00/0xe79af2f39bbdc68e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165532b expref: 19 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535898.212614:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc695 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165532b expref: 18 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535898.212633:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9005b7b03d00) 00010000:00010000:3.0:1788535898.212637:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788535898.212640:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030c00, rc 0) 00000100:00100000:3.0:1788535898.212701:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+18:10522:x1875415548320896:12345-192.168.203.13@tcp:101:rm.0 Request processed in 426us (621us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788535898.212709:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:2.0:1788535898.219540:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535898.222826:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548321024 00000100:00100000:0.0:1788535898.222841:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548321024 00000100:00100000:0.0:1788535898.222908:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788535898.222919:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+18:10522:x1875415548321024:12345-192.168.203.13@tcp:41:rm.0 00000004:00000024:2.0:1788535898.228673:0:10016:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1788535898.228766:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+18:10522:x1875415548321024:12345-192.168.203.13@tcp:41:rm.0 Request processed in 5844us (9239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535898.228776:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788535898.242758:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535898.243653:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548321152 00000100:00100000:1.0:1788535898.243663:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548321152 00000100:00100000:1.0:1788535898.243723:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:1.0:1788535898.243732:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+18:10522:x1875415548321152:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1788535898.243767:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535898.243787:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc6a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655332 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.243850:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.243864:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.243876:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.243887:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.243893:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.243900:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244021:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc6b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244031:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244039:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535898.244251:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788535898.244261:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535898.244284:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244298:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244306:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244312:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244318:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244324:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e440400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535898.244328:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244334:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244347:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9005b7b03d00) 00010000:00010000:1.0:1788535898.244350:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535898.244355:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244362:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440400/0xe79af2f39bbdc6aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244375:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244391:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244397:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244402:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e440200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535898.244405:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244411:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244419:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x76b728a6 (ffff9005b7b03c00) 00010000:00010000:1.0:1788535898.244421:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535898.244424:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244430:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440200/0xe79af2f39bbdc6b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244454:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440c00/0xe79af2f39bbdc6a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655332 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244466:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655332 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.244473:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90058aeb5f00) 00010000:00010000:1.0:1788535898.244475:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535898.244483:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f600, rc 0) 00000100:00100000:1.0:1788535898.244766:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+19:10522:x1875415548321152:12345-192.168.203.13@tcp:101:rm.0 Request processed in 1033us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535898.244775:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:1.0:1788535898.257232:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535898.257588:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548321408 00000100:00100000:2.0:1788535898.257598:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548321408 00000100:00100000:2.0:1788535898.257654:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788535898.257663:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:10522:x1875415548321408:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:2.0:1788535898.257713:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788535898.257739:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc6b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655332 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257759:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441000/0xe79af2f39bbdc664 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655316 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257770:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90058aeb5f00) 00010000:00010000:2.0:1788535898.257779:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441400/0xe79af2f39bbdc679 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165531d expref: 17 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257787:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9005b7b03d00) 00010000:00010000:2.0:1788535898.257790:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535898.257810:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257835:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257846:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257858:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257866:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257872:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257969:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257978:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.257984:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788535898.260297:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788535898.260313:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357064166193ns, next at 358064163148ns, rc = 0 00010000:00010000:2.0:1788535898.260396:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260411:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260432:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260441:0:6534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260447:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260453:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260474:0:6534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788535898.260495:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260502:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260508:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260514:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535898.260518:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260524:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260535:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90058aeb5f00) 00010000:00010000:2.0:1788535898.260537:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788535898.260548:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260553:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260572:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260579:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260584:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260588:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535898.260590:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260595:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260602:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9005b7b03d00) 00010000:00010000:2.0:1788535898.260605:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535898.260607:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260612:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535898.260620:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000053b84fee reply state 0000000084468ff6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260640:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.260646:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x76b728a6 (ffff9005b7b03c00) 00010000:00010000:2.0:1788535898.260648:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788535898.260650:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788535898.260851:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535898.260858:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.260864:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788535898.260868:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.260874:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.260883:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90058aeb5f00) 00010000:00010000:1.0:1788535898.260885:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788535898.260888:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.260893:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461000/0xe79af2f39bbdc6d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535898.260902:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535898.260904:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535898.260906:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535898.261291:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:10522:x1875415548321408:12345-192.168.203.13@tcp:36:rm.0 Request processed in 3624us (4062us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788535898.261301:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788535898.266558:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535898.266647:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548321664 00000100:00100000:0.0:1788535898.266657:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548321664 00000100:00100000:0.0:1788535898.267557:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1788535898.267571:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:10522:x1875415548321664:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:0.0:1788535898.267786:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:10522:x1875415548321664:12345-192.168.203.13@tcp:35:rm.0 Request processed in 219us (1236us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788535898.267794:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788535898.271388:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535898.271497:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548321920 00000100:00100000:0.0:1788535898.271507:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548321920 00000100:00100000:2.0:1788535898.271650:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788535898.271659:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+19:10522:x1875415548321920:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:2.0:1788535898.271709:0:10016:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788535898.271734:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc695 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165532b expref: 19 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271753:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e441c00/0xe79af2f39bbdc633 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655308 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271763:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9005b7b03d00) 00010000:00010000:2.0:1788535898.271777:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440600/0xe79af2f39bbdc5f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552fa expref: 17 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271785:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5000) 00010000:00010000:2.0:1788535898.271790:0:10016:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535898.271823:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271836:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271846:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271857:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271876:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271884:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271978:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271987:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.271994:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535898.272421:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788535898.272435:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272443:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272460:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272466:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535898.272471:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272479:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272488:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90058aeb5600) 00010000:00010000:2.0:1788535898.272491:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788535898.272495:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272502:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460e00/0xe79af2f39bbdc6e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272518:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272524:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272530:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272534:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535898.272537:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.272552:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.273668:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90058aeb5700) 00010000:00010000:2.0:1788535898.273672:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535898.273677:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.273684:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460c00/0xe79af2f39bbdc6db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535898.273712:0:10016:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000d065294e reply state 00000000038fc262 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.273724:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535898.273730:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90058aeb5100) 00010000:00010000:2.0:1788535898.273733:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788535898.273735:0:10016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788535898.274221:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+18:10522:x1875415548321920:12345-192.168.203.13@tcp:36:rm.0 Request processed in 2559us (2838us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788535898.274230:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00010000:00010000:3.0:1788535898.284372:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535898.540572:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569374720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535898.540641:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535898.541084:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569374720 00000100:00100000:2.0:1788535898.541092:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569374720 00000100:00100000:2.0:1788535898.541143:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788535898.541187:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569374720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788535898.541229:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1788535898.541285:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569374720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535898.541306:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788535898.541386:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569374720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535899.012507:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535899.012553:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535899.012586:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535899.012686:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548322304 00000100:00100000:0.0:1788535899.012700:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548322304 00000100:00100000:0.0:1788535899.012757:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:0.0:1788535899.012768:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548322304:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535899.012872:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548322304:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 97us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535899.012881:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:2.0:1788535899.012986:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548322048 00000100:00100000:2.0:1788535899.013000:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548322048 00000100:00100000:2.0:1788535899.013036:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 332 00000100:00100000:2.0:1788535899.013044:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548322048:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535899.013072:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548322048:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535899.013078:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 332 00000100:00100000:1.0:1788535899.013540:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535899.020049:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535899.020733:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548322560 00000100:00100000:3.0:1788535899.020746:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548322560 00000100:00100000:3.0:1788535899.020851:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548322176 00000100:00100000:3.0:1788535899.020854:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548322176 00000100:00080000:0.0:1788535899.020953:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535899.020990:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:0.0:1788535899.021014:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548322560:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535899.021086:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548322560:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (8499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535899.021094:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:3.0:1788535899.021712:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:3.0:1788535899.021721:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548322176:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535899.021767:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548322176:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 48us (8227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535899.021774:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:3.0:1788535899.024909:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548322432 00000100:00100000:3.0:1788535899.024923:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548322432 00000100:00100000:3.0:1788535899.025003:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:3.0:1788535899.025014:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548322432:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:0.0:1788535899.025185:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535899.025292:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548322432:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 279us (5253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535899.025325:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00010000:00010000:1.0:1788535899.308452:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535900.333532:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535901.101443:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569375104:0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.101506:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535901.101550:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569375616:0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.101573:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535901.101596:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569376128:0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.101615:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535901.101642:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788535901.101648:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569375232:0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.101671:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535901.101687:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569375744:0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.101720:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535901.101738:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569376256:0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.101758:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535901.101791:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569375104 00000100:00100000:1.0:1788535901.101797:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569375104 00000100:00100000:1.0:1788535901.101847:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788535901.101857:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569375104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.101907:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569375104:12345-0@lo:400:kworker.0 Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535901.101914:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788535901.101936:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569375616 00000100:00100000:1.0:1788535901.101939:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569375616 00000100:00100000:1.0:1788535901.101970:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569376128 00000100:00100000:1.0:1788535901.101973:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569376128 00000100:00100000:1.0:1788535901.102012:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569375232 00000100:00100000:1.0:1788535901.102015:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569375232 00000100:00100000:1.0:1788535901.102028:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788535901.102033:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569375616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.102064:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569375616:12345-0@lo:400:kworker.0 Request processed in 30us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535901.102070:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788535901.102080:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788535901.102086:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569376128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.102110:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569376128:12345-0@lo:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535901.102116:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788535901.102126:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788535901.102131:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569375232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.102183:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569375232:12345-0@lo:400:kworker.0 Request processed in 51us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535901.102189:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788535901.102211:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569375744 00000100:00100000:1.0:1788535901.102214:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569375744 00000100:00100000:1.0:1788535901.102238:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569376256 00000100:00100000:1.0:1788535901.102241:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569376256 00000100:00100000:1.0:1788535901.102258:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788535901.102264:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569375744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.102292:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569375744:12345-0@lo:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535901.102298:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788535901.102308:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788535901.102321:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569376256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.102349:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569376256:12345-0@lo:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535901.102355:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788535901.102376:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535901.102381:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535901.102383:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788535901.102422:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569375232:0@lo:400:kworker.0 00010000:00080000:1.0:1788535901.102435:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e563100 x1875415569375744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535901.102444:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569375744:0@lo:400:kworker.0 00010000:00080000:1.0:1788535901.102453:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e561c00 x1875415569376256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535901.102459:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569376256:0@lo:400:kworker.0 00000100:00100000:1.0:1788535901.102468:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569375104:0@lo:400:kworker.0 00010000:00080000:1.0:1788535901.102476:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e561f80 x1875415569375616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535901.102482:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569375616:0@lo:400:kworker.0 00010000:00080000:1.0:1788535901.102490:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e561500 x1875415569376128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535901.102497:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569376128:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.102816:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569374976:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.102862:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535901.102890:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569375488:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.102909:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535901.102935:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569376000:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.102953:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535901.102972:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788535901.102995:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569374848:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103022:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535901.103043:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569375360:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103064:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535901.103081:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569375872:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103101:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535901.103115:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569376384:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103133:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535901.103182:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569374976 00000100:00100000:3.0:1788535901.103187:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569374976 00000100:00100000:3.0:1788535901.103214:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569375488 00000100:00100000:3.0:1788535901.103217:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569375488 00000100:00100000:3.0:1788535901.103236:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569376000 00000100:00100000:3.0:1788535901.103239:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569376000 00000100:00100000:3.0:1788535901.103252:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788535901.103259:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569374976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103296:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569374976:12345-0@lo:400:kworker.0 Request processed in 37us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535901.103312:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788535901.103326:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788535901.103332:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569375488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103361:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569375488:12345-0@lo:400:kworker.0 Request processed in 29us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535901.103367:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788535901.103379:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788535901.103396:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569376000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103424:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569376000:12345-0@lo:400:kworker.0 Request processed in 39us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535901.103429:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788535901.103450:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569374848 00000100:00100000:3.0:1788535901.103454:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569374848 00000100:00100000:3.0:1788535901.103481:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788535901.103487:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569374848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103514:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569374848:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535901.103520:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788535901.103552:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569375872 00000100:00100000:3.0:1788535901.103556:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569375872 00000100:00100000:3.0:1788535901.103578:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569376384 00000100:00100000:3.0:1788535901.103581:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569376384 00000100:00100000:3.0:1788535901.103598:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788535901.103604:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569375872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103633:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569375872:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535901.103648:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788535901.103662:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788535901.103667:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569376384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103695:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569376384:12345-0@lo:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535901.103876:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1788535901.103895:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535901.103898:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535901.103900:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535901.103910:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569375360 00000100:00100000:3.0:1788535901.103913:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569375360 00000100:00100000:3.0:1788535901.103936:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788535901.103942:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569375360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.103988:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569375360:12345-0@lo:400:kworker.0 Request processed in 34us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535901.103994:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788535901.104030:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569374848:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.104040:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569375360:0@lo:400:kworker.0 00010000:00080000:3.0:1788535901.104052:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e561180 x1875415569375872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535901.104061:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569375872:0@lo:400:kworker.0 00010000:00080000:3.0:1788535901.104070:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e560a80 x1875415569376384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535901.104078:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569376384:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.104097:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569374976:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.104107:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569375488:0@lo:400:kworker.0 00000100:00100000:3.0:1788535901.104115:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569376000:0@lo:400:kworker.0 00010000:00010000:3.0:1788535901.362050:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788535901.612457:0:10023:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360416307193ns, next at 361416304994ns, rc = 0 00000100:00100000:2.0:1788535901.612614:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535901.612644:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569376512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535901.612706:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535901.612783:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569376512 00000100:00100000:2.0:1788535901.612790:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569376512 00000100:00100000:2.0:1788535901.612840:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788535901.612849:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569376512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535901.612875:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535901.612925:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569376512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535901.612932:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1788535901.613021:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e756d80 x1875415569376512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535901.613040:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569376512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535901.616006:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535901.616027:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569376640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535901.616083:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535901.616270:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569376640 00000100:00100000:0.0:1788535901.616277:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569376640 00000100:00100000:0.0:1788535901.616324:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788535901.616333:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569376640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535901.616359:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535901.616411:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569376640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535901.616417:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1788535901.616492:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e755880 x1875415569376640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535901.616544:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569376640:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788535902.382483:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535902.636400:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535902.636425:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569376768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535902.636523:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535902.636639:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569376768 00000100:00100000:3.0:1788535902.636650:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569376768 00000100:00100000:3.0:1788535902.636712:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788535902.636723:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569376768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535902.636758:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535902.636814:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569376768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535902.636822:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1788535902.636883:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487467100 x1875415569376768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535902.636903:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569376768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535902.648051:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569376896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535902.648117:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535902.648201:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569376896 00000100:00100000:2.0:1788535902.648214:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569376896 00000100:00100000:2.0:1788535902.648258:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788535902.648267:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569376896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788535902.648289:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535902.648333:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569376896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535902.648340:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788535902.648386:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900485d90380 x1875415569376896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535902.648403:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569376896:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788535902.693528:0:13695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788535903.149701:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535903.149724:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569377024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535903.149792:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535903.150029:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569377024 00000100:00100000:3.0:1788535903.150038:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569377024 00000100:00100000:3.0:1788535903.150099:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788535903.150122:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569377024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788535903.150192:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535903.150249:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569377024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535903.150256:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788535903.150402:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569377024:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535903.406366:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535903.663399:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569377152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788535903.663472:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535903.663585:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569377152 00000100:00100000:3.0:1788535903.663593:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569377152 00000100:00100000:3.0:1788535903.663661:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788535903.663672:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569377152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535903.663707:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788535903.663760:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569377152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535903.663768:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788535903.663925:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569377152:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1788535903.809463:0:13744:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7eafdc30 20000000:00000080:3.0:1788535903.809480:0:13744:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9005b7820c00 uarg=0000000000000000 20000000:01000000:3.0:1788535903.809523:0:13744:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788535903.809529:0:13744:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788535903.809534:0:13744:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788535903.812294:0:13745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788535903.812649:0:13744:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788535903.817320:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788535903.818719:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788535903.818761:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788535903.818781:0:13744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788535903.818811:0:13744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.818827:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc57d expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.818834:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc58b expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.818840:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc599 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.818850:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552e5 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.818858:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc5a7 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.818866:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ec expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.818885:0:13744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.818922:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ec expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.818938:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ec expref: 12 pid: 6529 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535903.818952:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377280:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535903.819054:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc5a7 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.819063:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc5a7 expref: 23 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535903.819073:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377408:0@lo:104: 00000100:00100000:0.0:1788535903.819110:0:13744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788535903.819141:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552e5 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.819170:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552e5 expref: 12 pid: 6528 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535903.819179:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e756300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377536:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535903.819218:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc599 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.819250:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc599 expref: 23 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535903.819257:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e757480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377664:0@lo:104: 00010000:00010000:0.0:1788535903.819282:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc58b expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.819290:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc58b expref: 23 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535903.819297:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377792:0@lo:104: 00010000:00010000:0.0:1788535903.819321:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdc57d expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.819328:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdc57d expref: 23 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535903.819336:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377920:0@lo:104: 00000100:00100000:0.0:1788535903.819354:0:13744:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535903.820299:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788535903.820326:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535903.820353:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535903.820362:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535903.820370:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569377408 00000100:00100000:0.0:1788535903.820377:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569377408 00000100:00100000:0.0:1788535903.820480:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569377664 00000100:00100000:0.0:1788535903.820484:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569377664 00000100:00100000:0.0:1788535903.820496:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569377792 00000100:00100000:0.0:1788535903.820499:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569377792 00000100:00100000:0.0:1788535903.820520:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569377920 00000100:00100000:0.0:1788535903.820522:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569377920 00000100:00100000:0.0:1788535903.820533:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788535903.820541:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+6:13744:x1875415569377408:12345-0@lo:104: 00010000:00010000:0.0:1788535903.820556:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.820608:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788535903.820614:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+6:13744:x1875415569377408:12345-0@lo:104: Request processed in 73us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535903.820621:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788535903.820658:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788535903.820665:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+5:13744:x1875415569377664:12345-0@lo:104: 00010000:00010000:0.0:1788535903.820672:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.820708:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788535903.820713:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+5:13744:x1875415569377664:12345-0@lo:104: Request processed in 49us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535903.820719:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788535903.820729:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788535903.820735:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:13744:x1875415569377792:12345-0@lo:104: 00010000:00010000:0.0:1788535903.820747:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.820776:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788535903.820781:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+4:13744:x1875415569377792:12345-0@lo:104: Request processed in 47us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535903.820796:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788535903.820807:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788535903.820812:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:13744:x1875415569377920:12345-0@lo:104: 00010000:00010000:0.0:1788535903.820820:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.820844:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788535903.820849:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:89006101-b582-4041-a87b-c8866dc8e13c+3:13744:x1875415569377920:12345-0@lo:104: Request processed in 38us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535903.820854:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788535903.820870:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788535903.820875:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.820882:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50400 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535903.820885:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.820894:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535903.820901:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535903.820908:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788535903.820936:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.820942:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535903.820982:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.820990:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058af50400/0xe79af2f39bbdc5a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc5b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821002:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788535903.821006:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821012:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51c00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535903.821016:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821022:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535903.821029:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535903.821034:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788535903.821046:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821051:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535903.821063:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821070:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058af51c00/0xe79af2f39bbdc599 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc5a0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821079:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788535903.821088:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821094:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50a00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535903.821097:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821104:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535903.821110:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535903.821115:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788535903.821127:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821133:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535903.821138:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821175:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058af50a00/0xe79af2f39bbdc58b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc592 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821185:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535903.821189:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821195:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e441800 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535903.821197:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821213:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535903.821220:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535903.821225:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788535903.821305:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821312:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535903.821318:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821324:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e441800/0xe79af2f39bbdc57d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdc584 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535903.821337:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535903.821339:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535903.821341:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535903.821355:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569378432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535903.821388:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535903.821484:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535903.821491:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569378048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535903.821513:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535903.821539:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569378176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535903.821563:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535903.821567:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569378304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788535903.821607:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535903.821616:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377408:0@lo:104: 00000100:00100000:0.0:1788535903.821637:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e757480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377664:0@lo:104: 00000100:00100000:2.0:1788535903.821646:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569378432 00000100:00100000:0.0:1788535903.821650:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377792:0@lo:104: 00000100:00100000:2.0:1788535903.821652:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569378432 00000100:00100000:0.0:1788535903.821662:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377920:0@lo:104: 00010000:00010000:2.0:1788535903.821680:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc57d expref: 24 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535903.821697:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569378048 00000100:00100000:2.0:1788535903.821700:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569378048 00010000:00010000:2.0:1788535903.821708:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc5a7 expref: 25 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535903.821718:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569378176 00000100:00100000:2.0:1788535903.821720:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569378176 00010000:00010000:2.0:1788535903.821729:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc599 expref: 26 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535903.821738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569378304 00000100:00100000:2.0:1788535903.821740:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569378304 00010000:00010000:2.0:1788535903.821756:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc58b expref: 27 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535903.821768:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788535903.821774:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+27:3662:x1875415569378432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535903.821785:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535903.821790:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc57d expref: 27 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.821800:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc57d expref: 27 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.821814:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51400/0xe79af2f39bbdc584 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc57d expref: 27 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.821826:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535903.821858:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+26:3662:x1875415569378432:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535903.821864:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788535903.821882:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788535903.821888:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569378432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788535903.821890:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+25:3662:x1875415569378048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535903.821901:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535903.821906:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc5a7 expref: 25 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.821916:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc5a7 expref: 25 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.821926:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51000/0xe79af2f39bbdc5b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc5a7 expref: 25 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.821945:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535903.821987:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+24:3662:x1875415569378048:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535903.821993:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788535903.822005:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788535903.822011:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+23:3660:x1875415569378176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535903.822019:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535903.822169:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535903.822238:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc599 expref: 23 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.822249:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc599 expref: 23 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.822260:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51200/0xe79af2f39bbdc5a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc599 expref: 23 pid: 6526 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.822270:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535903.822358:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+22:3660:x1875415569378176:12345-0@lo:103:ldlm_bl.0 Request processed in 347us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535903.822366:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788535903.822379:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788535903.822386:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+21:3661:x1875415569378304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535903.822394:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535903.822399:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdc58b expref: 21 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.822408:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdc58b expref: 21 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.822423:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc592 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdc58b expref: 21 pid: 6528 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.822432:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535903.822458:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+20:3661:x1875415569378304:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535903.822464:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788535903.822490:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569378304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535903.822588:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569378176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535903.822863:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9005894ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569378048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788535903.823200:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788535903.824603:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788535903.824633:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788535903.824642:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788535903.825006:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825020:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825039:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825046:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e440000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535903.825051:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825060:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825080:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x76b728a6 (ffff9005b7b03c00) 00010000:00010000:2.0:1788535903.825083:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788535903.825085:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788535903.825088:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535903.825106:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569378560:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788535903.825121:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e440000/0xe79af2f39bbdc648 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825139:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825164:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825172:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825178:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535903.825182:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825192:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535903.825192:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788535903.825205:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90058aeb5f00) 00010000:00010000:2.0:1788535903.825208:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535903.825211:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825219:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdc65d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825237:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825243:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825255:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825260:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535903.825263:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825270:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825277:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x76b728a6 (ffff9005b7b03c00) 00010000:00010000:2.0:1788535903.825279:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535903.825282:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825287:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdc6c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x76b728a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825307:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825321:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825328:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825334:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535903.825337:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535903.825351:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569378560 00010000:00010000:2.0:1788535903.825353:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535903.825360:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569378560 00010000:00010000:2.0:1788535903.825364:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90058aeb5100) 00010000:00010000:2.0:1788535903.825368:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535903.825372:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535903.825379:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc6e2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535903.825469:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788535903.825479:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569378560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788535903.825501:0:10017:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788535903.825532:0:10017:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ae45a, atime: 0x6a9ae45a, ctime: 0x6a9ae45a, blocks: 0x0 00010000:00010000:1.0:1788535903.825539:0:10017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825554:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1788535903.825558:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535903.825565:0:10017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825582:0:10017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825591:0:10017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825600:0:10017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825623:0:10017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788535903.825767:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569378560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 289us (577us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788535903.825780:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1788535903.825821:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff900487a80e00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788535903.825828:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569378560:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788535903.825855:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535903.825860:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825867:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788535903.825870:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825878:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825891:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825898:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdc6f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.825911:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535903.825913:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535903.825920:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535903.826003:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535903.826044:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535903.826064:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548322688 00000100:00100000:1.0:1788535903.826069:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548322688 00010000:00010000:1.0:1788535903.826088:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ec expref: 13 pid: 6529 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535903.826105:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548322816 00000100:00100000:1.0:1788535903.826107:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548322816 00010000:00010000:1.0:1788535903.826117:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552e5 expref: 14 pid: 6528 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535903.826133:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1788535903.826138:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91b20ee6-59cb-4913-858f-bc518949fc4a+14:2402:x1875415548322688:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535903.826167:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535903.826173:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ec expref: 14 pid: 6529 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826183:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ec expref: 14 pid: 6529 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826196:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535903.826244:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91b20ee6-59cb-4913-858f-bc518949fc4a+14:2402:x1875415548322688:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535903.826251:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1788535903.826268:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788535903.826276:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e562680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548322816:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535903.826283:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535903.826294:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552e5 expref: 13 pid: 6528 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826304:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552e5 expref: 13 pid: 6528 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826315:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826323:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826338:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826345:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826352:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826358:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826364:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455a00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788535903.826367:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826374:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826382:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.826398:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535903.826419:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e562680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548322816:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 144us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535903.826425:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00010000:00010000:1.0:1788535903.828171:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461800/0xe79af2f39bbdc5bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ec expref: 12 pid: 6529 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535903.828190:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377280:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535903.828203:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e441a00/0xe79af2f39bbdc5ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552e5 expref: 11 pid: 6528 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535903.828211:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e756300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875415569377536:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535903.828248:0:13744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.828258:0:13744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.828264:0:13744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535903.828270:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e455a00/0xe79af2f39bbdc6f0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788535903.831037:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535904.125757:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535904.125854:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535904.127674:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535904.127784:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548323072 00000100:00100000:0.0:1788535904.127794:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548323072 00000100:00100000:2.0:1788535904.127908:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535904.127948:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535904.127992:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548323200 00000100:00100000:0.0:1788535904.127996:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548323200 00000100:00100000:0.0:1788535904.128057:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1788535904.128068:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548323200:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535904.128138:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548323200:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535904.128168:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00080000:0.0:1788535904.128193:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788535904.131925:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548323328 00000100:00100000:1.0:1788535904.131942:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548323328 00000100:00100000:3.0:1788535904.131943:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548322944 00000100:00100000:3.0:1788535904.131946:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548322944 00000100:00100000:2.0:1788535904.131983:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548323456 00000100:00100000:2.0:1788535904.131987:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548323456 00000100:00100000:2.0:1788535904.132021:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:2.0:1788535904.132031:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548323072:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535904.132118:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548323072:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 87us (6370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535904.132126:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:2.0:1788535904.132143:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:3.0:1788535904.132226:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:3.0:1788535904.132233:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548323456:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535904.132275:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548323456:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (4326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535904.132282:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:3.0:1788535904.132295:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:3.0:1788535904.132301:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548322944:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535904.132329:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548322944:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (4664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535904.132335:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00080000:0.0:1788535904.132537:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788535904.132542:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535904.133905:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548323328:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535904.135239:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548323328:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 3061us (9374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535904.135253:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00010000:00010000:3.0:1788535904.428244:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788535904.675565:0:13793:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7f6e5b80 20000000:00000080:3.0:1788535904.675583:0:13793:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9005b78df000 uarg=0000000000000000 20000000:01000000:3.0:1788535904.675625:0:13793:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788535904.675632:0:13793:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788535904.675637:0:13793:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788535904.676571:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788535904.677000:0:13793:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788535904.677111:0:13793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788535904.677138:0:13793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788535904.677177:0:13793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788535904.677193:0:13793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788535904.677216:0:13793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677232:0:13793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677242:0:13793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677248:0:13793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677255:0:13793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677262:0:13793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677268:0:13793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788535904.677273:0:13793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677281:0:13793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677292:0:13793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677316:0:13793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535904.677323:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461200/0xe79af2f39bbdc6fe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535905.082592:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535905.082696:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548323584 00000100:00100000:0.0:1788535905.082706:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548323584 00000100:00100000:0.0:1788535905.082760:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 334 00000100:00100000:0.0:1788535905.082770:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+11:6172:x1875415548323584:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535905.082802:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535905.082821:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc705 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655339 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535905.082849:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655339 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535905.082861:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655339 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535905.082870:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454000, rc 0) 00000100:00100000:0.0:1788535905.082934:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548323584:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 165us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535905.082941:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 334 00000100:00100000:0.0:1788535905.088234:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535905.088351:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548323712 00000100:00100000:2.0:1788535905.088360:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548323712 00000100:00100000:2.0:1788535905.088413:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 335 00000100:00100000:2.0:1788535905.088422:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548323712:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.088568:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548323712:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.088576:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 335 00000100:00100000:1.0:1788535905.096355:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535905.100939:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548323840 00000100:00100000:3.0:1788535905.100964:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548323840 00000100:00100000:3.0:1788535905.101184:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 336 00000100:00100000:3.0:1788535905.101196:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548323840:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535905.101343:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548323840:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 148us (4996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.101351:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 336 00000100:00100000:3.0:1788535905.107276:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535905.107546:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548323968 00000100:00100000:1.0:1788535905.107568:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548323968 00000100:00100000:1.0:1788535905.107622:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 337 00000100:00100000:1.0:1788535905.107631:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+12:10807:x1875415548323968:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788535905.107778:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+12:10807:x1875415548323968:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 147us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535905.107787:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 337 00000100:00100000:0.0:1788535905.113828:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535905.113904:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548324096 00000100:00100000:3.0:1788535905.113914:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548324096 00000100:00100000:3.0:1788535905.113995:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 338 00000100:00100000:3.0:1788535905.114006:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+12:10807:x1875415548324096:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788535905.114198:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+12:10807:x1875415548324096:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 193us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.114206:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 338 00000100:00100000:3.0:1788535905.127724:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535905.134048:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548324224 00000100:00100000:2.0:1788535905.134068:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548324224 00000100:00100000:2.0:1788535905.134525:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 339 00000100:00100000:2.0:1788535905.134536:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+12:6172:x1875415548324224:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535905.134552:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535905.134569:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc70c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.134596:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc70c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655340 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.134607:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc70c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655340 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.134635:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461000, rc 0) 00000100:00100000:2.0:1788535905.134711:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548324224:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 176us (6995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.134719:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 339 00000100:00100000:1.0:1788535905.142592:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535905.142792:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548324352 00000100:00100000:3.0:1788535905.142805:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548324352 00000100:00100000:3.0:1788535905.142864:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 340 00000100:00100000:3.0:1788535905.142874:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548324352:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535905.143049:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548324352:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 176us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.143057:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 340 00000100:00100000:0.0:1788535905.145006:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535905.145175:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548324480 00000100:00100000:3.0:1788535905.145183:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548324480 00000100:00100000:3.0:1788535905.145230:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 341 00000100:00100000:3.0:1788535905.145240:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548324480:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535905.145423:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d476450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:6172:x1875415548324480:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 184us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.145432:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 341 00000100:00100000:0.0:1788535905.149845:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535905.149982:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548324608 00000100:00100000:3.0:1788535905.149992:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548324608 00000100:00100000:3.0:1788535905.150038:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 342 00000100:00100000:3.0:1788535905.150048:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:10810:x1875415548324608:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788535905.150193:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:10810:x1875415548324608:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 146us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.150207:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 342 00000100:00100000:0.0:1788535905.164654:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535905.164742:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548324736 00000100:00100000:2.0:1788535905.164750:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548324736 00000100:00100000:2.0:1788535905.164800:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 343 00000100:00100000:2.0:1788535905.164809:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:10810:x1875415548324736:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788535905.164947:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d477c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:10810:x1875415548324736:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 139us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.164964:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 343 10000000:01000000:0.0:1788535905.262765:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788535905.262775:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900485fef800 from 7 10000000:01000000:0.0:1788535905.262781:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788535905.262830:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535905.262842:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535905.262854:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535905.262893:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569378688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788535905.262972:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535905.263043:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535905.263113:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569378688 00000100:00100000:1.0:1788535905.263121:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569378688 00000100:00100000:1.0:1788535905.263195:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788535905.263217:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+20:6531:x1875415569378688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788535905.263231:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535905.263244:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059620ea00/0xe79af2f39bbdc71a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc713 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535905.263269:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059620ea00/0xe79af2f39bbdc71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc713 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535905.263280:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059620ea00/0xe79af2f39bbdc71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc713 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535905.263289:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620ea00, rc 0) 00000100:00100000:1.0:1788535905.263325:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569378688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535905.263332:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788535905.263699:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569378688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788535905.263716:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535905.263726:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535905.263791:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569378816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535905.263820:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535905.263848:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535905.263901:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569378816 00000100:00100000:3.0:1788535905.263906:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569378816 00000100:00100000:3.0:1788535905.263940:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788535905.263958:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569378816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535905.264070:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d475450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569378816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.264077:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788535905.264196:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569378816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535905.264231:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569378944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535905.264268:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535905.264292:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.264337:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569378944 00000100:00100000:2.0:1788535905.264341:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569378944 00000100:00100000:2.0:1788535905.264369:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788535905.264376:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569378944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.264451:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569378944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.264457:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788535905.264588:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569378944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535905.264922:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13806:1875415569379072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535905.264964:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535905.264982:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788535905.265027:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569379072 00000100:00100000:1.0:1788535905.265031:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569379072 00000100:00100000:1.0:1788535905.265061:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788535905.265074:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:13806:x1875415569379072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788535905.265184:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+21:13806:x1875415569379072:12345-0@lo:502:llog_process_th.0 Request processed in 110us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535905.265191:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788535905.265278:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13806:1875415569379072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535905.265299:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535905.265309:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535905.265312:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788535905.265321:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff900485fef800 00000020:00000080:3.0:1788535905.265324:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788535905.265375:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535905.265379:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535905.265380:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788535905.265383:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535905.265385:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535905.265386:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788535905.265390:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff900485fef800 00000020:00000080:3.0:1788535905.265392:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788535905.265423:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13806:1875415569379200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535905.265456:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535905.265483:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569379200 00000100:00100000:3.0:1788535905.265487:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569379200 00000100:00100000:3.0:1788535905.265506:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788535905.265512:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:13806:x1875415569379200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535905.265577:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:13806:x1875415569379200:12345-0@lo:502:llog_process_th.0 Request processed in 64us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.265583:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788535905.265616:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788535905.265628:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13806:1875415569379200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535905.265645:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535905.265649:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535905.265650:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788535905.265654:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788535905.267718:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788535905.267764:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788535905.267773:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.267784:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535905.267805:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788535905.267808:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005893a3800 from 7 10000000:01000000:2.0:1788535905.267810:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788535905.267842:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.267850:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.267859:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535905.267880:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569379328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.267930:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.267978:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788535905.268032:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569379328 00000100:00100000:3.0:1788535905.268039:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569379328 00000100:00100000:3.0:1788535905.268080:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788535905.268089:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+21:6531:x1875415569379328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535905.268098:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535905.268109:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580031a00/0xe79af2f39bbdc728 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc721 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535905.268132:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580031a00/0xe79af2f39bbdc728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc721 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535905.268143:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580031a00/0xe79af2f39bbdc728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc721 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535905.268173:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580031a00, rc 0) 00000100:00100000:2.0:1788535905.268360:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569379328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535905.268375:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.268384:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535905.268434:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569379456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788535905.268470:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569379328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 382us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.268484:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788535905.271380:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.271439:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.271461:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569379456 00000100:00100000:2.0:1788535905.271468:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569379456 00000100:00100000:2.0:1788535905.271739:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788535905.271750:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569379456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.272018:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569379456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.272027:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788535905.272077:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569379456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.272265:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569379584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.272309:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.272325:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788535905.272755:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569379584 00000100:00100000:3.0:1788535905.272761:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569379584 00000100:00100000:3.0:1788535905.272801:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788535905.272810:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569379584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535905.272917:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569379584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.272924:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788535905.273031:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569379584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.273750:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13808:1875415569379712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535905.273793:0:13808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.273817:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.273837:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569379712 00000100:00100000:2.0:1788535905.273843:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569379712 00000100:00100000:2.0:1788535905.273889:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788535905.273897:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:13808:x1875415569379712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535905.273989:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+22:13808:x1875415569379712:12345-0@lo:502:llog_process_th.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.273996:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788535905.274035:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13808:1875415569379712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535905.274057:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535905.274066:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535905.274068:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788535905.274080:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9005893a3800 00000020:00000080:2.0:1788535905.274082:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788535905.274125:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535905.274142:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535905.274165:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788535905.274169:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535905.274172:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535905.274174:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788535905.274177:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9005893a3800 00000020:00000080:2.0:1788535905.274179:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788535905.274210:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13808:1875415569379840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535905.274241:0:13808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.274259:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569379840 00000100:00100000:2.0:1788535905.274263:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569379840 00000100:00100000:2.0:1788535905.274283:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788535905.274290:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:13808:x1875415569379840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535905.274347:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:13808:x1875415569379840:12345-0@lo:502:llog_process_th.0 Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.274354:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788535905.274389:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac8636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.274402:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13808:1875415569379840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535905.274430:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535905.274434:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535905.274435:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788535905.274439:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788535905.274482:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788535905.274499:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788535905.274507:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.274543:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535905.274554:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788535905.274557:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831a8000 from 7 10000000:01000000:2.0:1788535905.274559:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788535905.274580:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.274587:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.274596:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535905.274608:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569379968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.274632:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.274646:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac8636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.274656:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569379968 00000100:00100000:2.0:1788535905.274659:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569379968 00000100:00100000:2.0:1788535905.274677:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788535905.274682:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+22:6531:x1875415569379968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535905.274689:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535905.274699:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059e460200/0xe79af2f39bbdc736 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc72f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.274716:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059e460200/0xe79af2f39bbdc736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc72f expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.274738:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059e460200/0xe79af2f39bbdc736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc72f expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.274747:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460200, rc 0) 00000100:00100000:2.0:1788535905.274774:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569379968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.274779:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788535905.274804:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569379968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535905.274815:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.274824:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535905.274862:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.274883:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.274895:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac8636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.274906:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569380096 00000100:00100000:2.0:1788535905.274909:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569380096 00000100:00100000:2.0:1788535905.274924:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788535905.274934:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569380096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.275019:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569380096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.275026:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788535905.276736:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788535905.276788:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788535905.277011:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.277073:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569380224 00000100:00100000:2.0:1788535905.277081:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569380224 00000100:00100000:0.0:1788535905.277082:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.277207:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788535905.277218:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569380224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.277312:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569380224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.277319:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788535905.277406:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788535905.277727:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13810:1875415569380352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535905.277770:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535905.281099:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569380352 00000100:00100000:0.0:1788535905.281122:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569380352 00000100:00100000:3.0:1788535905.281127:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788535905.281241:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788535905.281252:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:13810:x1875415569380352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788535905.281389:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:13810:x1875415569380352:12345-0@lo:502:llog_process_th.0 Request processed in 138us (3619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535905.281397:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788535905.282270:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13810:1875415569380352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535905.282382:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535905.282392:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535905.282623:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788535905.282637:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9005831a8000 00000020:00000080:3.0:1788535905.282640:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788535905.282694:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535905.282698:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535905.282700:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788535905.282703:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788535905.282705:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535905.282707:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788535905.282710:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9005831a8000 00000020:00000080:3.0:1788535905.282713:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788535905.282768:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13810:1875415569380480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788535905.282837:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535905.282877:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ace3d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.282935:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569380480 00000100:00100000:2.0:1788535905.282942:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569380480 00000100:00100000:2.0:1788535905.282997:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788535905.283006:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:13810:x1875415569380480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535905.283101:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+23:13810:x1875415569380480:12345-0@lo:502:llog_process_th.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.283108:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788535905.289655:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13810:1875415569380480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788535905.289696:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788535905.289704:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788535905.289706:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788535905.289712:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788535905.289879:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788535905.289903:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788535905.289913:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.289925:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535905.289935:0:6531:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788535905.289938:0:6531:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9005831fb800 from 7 10000000:01000000:2.0:1788535905.289941:0:6531:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788535905.289987:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.289996:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.290017:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535905.290037:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.290101:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.290138:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788535905.290425:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569380608 00000100:00100000:3.0:1788535905.290432:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569380608 00000100:00100000:3.0:1788535905.290474:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788535905.290483:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+23:6531:x1875415569380608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788535905.290495:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535905.290506:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580030600/0xe79af2f39bbdc744 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdc73d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535905.290528:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580030600/0xe79af2f39bbdc744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdc73d expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535905.290539:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580030600/0xe79af2f39bbdc744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdc73d expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535905.290547:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030600, rc 0) 00000100:00100000:3.0:1788535905.290582:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569380608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535905.290587:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788535905.291007:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788535905.291021:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.291031:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535905.291090:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.291123:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.291176:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.291190:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569380736 00000100:00100000:2.0:1788535905.291194:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569380736 00000100:00100000:2.0:1788535905.291230:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788535905.291238:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569380736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.291341:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569380736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.291348:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788535905.291395:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.291419:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.291462:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.291476:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005831d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.291491:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569380864 00000100:00100000:2.0:1788535905.291494:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569380864 00000100:00100000:2.0:1788535905.291510:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788535905.291516:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569380864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.291586:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:6531:x1875415569380864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.291594:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788535905.291636:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:89006101-b582-4041-a87b-c8866dc8e13c:6531:1875415569380864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788535905.291781:0:13812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13812:1875415569380992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535905.291813:0:13812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.291829:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569380992 00000100:00100000:2.0:1788535905.291832:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569380992 00000100:00100000:2.0:1788535905.291867:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788535905.291874:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:13812:x1875415569380992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535905.291938:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:13812:x1875415569380992:12345-0@lo:502:llog_process_th.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.291945:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788535905.291986:0:13812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.292000:0:13812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13812:1875415569380992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535905.292022:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535905.292030:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535905.292032:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788535905.292038:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9005831fb800 00000020:00000080:2.0:1788535905.292045:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788535905.292097:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535905.292344:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535905.292346:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788535905.292351:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788535905.292354:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535905.292356:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788535905.292360:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9005831fb800 00000020:00000080:2.0:1788535905.292362:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788535905.292542:0:13812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13812:1875415569381120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788535905.292580:0:13812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535905.292602:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569381120 00000100:00100000:2.0:1788535905.292605:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569381120 00000100:00100000:2.0:1788535905.292629:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788535905.292637:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:13812:x1875415569381120:12345-0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788535905.292661:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788535905.292700:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:13812:x1875415569381120:12345-0@lo:502:llog_process_th.0 Request processed in 64us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535905.292707:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788535905.292739:0:13812:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462240 going to sleep for 11 seconds 00000100:00100000:2.0:1788535905.292753:0:13812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:89006101-b582-4041-a87b-c8866dc8e13c:13812:1875415569381120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788535905.292770:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788535905.292774:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788535905.292776:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788535905.292779:0:13812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788535905.292826:0:6531:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788535905.292842:0:6531:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788535905.292851:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535905.292872:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788535905.302978:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788535905.452304:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535906.221482:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569381376:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.221564:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.221631:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569381888:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.221656:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.221682:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569382400:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.221702:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.221723:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788535906.221729:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569381248:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.221769:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.221789:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569381760:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.221811:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.221826:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569382272:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.221847:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.221865:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569382784:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.221885:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.221909:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569381632:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.221931:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.221971:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569382144:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.221993:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.222008:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569382656:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222028:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.222044:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788535906.222050:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569381504:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222069:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.222084:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569382016:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222103:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.222116:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569382528:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222134:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535906.222187:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569381376 00000100:00100000:0.0:1788535906.222195:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569381376 00000100:00100000:0.0:1788535906.222234:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569381888 00000100:00100000:0.0:1788535906.222236:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569381888 00000100:00100000:0.0:1788535906.222259:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569382400 00000100:00100000:0.0:1788535906.222262:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569382400 00000100:00100000:0.0:1788535906.222273:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569381632 00000100:00100000:0.0:1788535906.222275:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569381632 00000100:00100000:0.0:1788535906.222284:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569382016 00000100:00100000:0.0:1788535906.222286:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569382016 00000100:00100000:0.0:1788535906.222297:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569382528 00000100:00100000:0.0:1788535906.222299:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569382528 00000100:00100000:0.0:1788535906.222316:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788535906.222323:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569381376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222375:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569381376:12345-0@lo:400:kworker.0 Request processed in 50us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222381:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788535906.222405:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788535906.222411:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569381888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222440:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569381888:12345-0@lo:400:kworker.0 Request processed in 30us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222445:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788535906.222455:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788535906.222461:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569382400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222486:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569382400:12345-0@lo:400:kworker.0 Request processed in 26us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222491:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788535906.222501:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788535906.222507:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569381632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222536:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569381632:12345-0@lo:400:kworker.0 Request processed in 29us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222542:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788535906.222553:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788535906.222559:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569382016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222584:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569382016:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222590:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788535906.222601:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788535906.222607:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569382528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222631:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569382528:12345-0@lo:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222637:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788535906.222661:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569382272 00000100:00100000:0.0:1788535906.222665:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569382272 00000100:00100000:0.0:1788535906.222682:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569382784 00000100:00100000:0.0:1788535906.222684:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569382784 00000100:00100000:0.0:1788535906.222695:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569382144 00000100:00100000:0.0:1788535906.222697:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569382144 00000100:00100000:0.0:1788535906.222707:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569382656 00000100:00100000:0.0:1788535906.222709:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569382656 00000100:00100000:0.0:1788535906.222719:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788535906.222725:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569382272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222757:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569382272:12345-0@lo:400:kworker.0 Request processed in 31us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222763:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788535906.222773:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788535906.222778:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569382784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222802:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569382784:12345-0@lo:400:kworker.0 Request processed in 25us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222808:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788535906.222818:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788535906.222824:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569382144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222848:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569382144:12345-0@lo:400:kworker.0 Request processed in 24us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222854:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788535906.222864:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788535906.222870:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569382656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.222892:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569382656:12345-0@lo:400:kworker.0 Request processed in 23us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.222907:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788535906.222931:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569381760 00000100:00100000:0.0:1788535906.222935:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569381760 00000100:00100000:0.0:1788535906.222965:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569381504 00000100:00100000:0.0:1788535906.222969:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569381504 00000100:00100000:0.0:1788535906.222979:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788535906.222985:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569381760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.223016:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569381760:12345-0@lo:400:kworker.0 Request processed in 31us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.223022:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788535906.223033:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788535906.223039:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569381504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.223064:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569381504:12345-0@lo:400:kworker.0 Request processed in 25us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535906.223070:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788535906.223085:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535906.223089:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535906.223091:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788535906.223093:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535906.223118:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569381504:0@lo:400:kworker.0 00010000:00080000:0.0:1788535906.223130:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488081c00 x1875415569382016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535906.223140:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569382016:0@lo:400:kworker.0 00010000:00080000:0.0:1788535906.223178:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488080000 x1875415569382528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535906.223186:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569382528:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.223205:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569381632:0@lo:400:kworker.0 00010000:00080000:0.0:1788535906.223213:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488083480 x1875415569382144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535906.223220:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569382144:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.223230:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569382656:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.223268:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569381760:0@lo:400:kworker.0 00010000:00080000:0.0:1788535906.223278:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488082a00 x1875415569382272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535906.223286:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569382272:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.223296:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569382784:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.223305:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569381376:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.223314:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569381888:0@lo:400:kworker.0 00000100:00100000:0.0:1788535906.223323:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569382400:0@lo:400:kworker.0 00000100:00100000:2.0:1788535906.223544:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569381248 00000100:00100000:2.0:1788535906.223549:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569381248 00000100:00100000:2.0:1788535906.223586:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788535906.223593:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569381248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535906.223638:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569381248:12345-0@lo:400:kworker.0 Request processed in 46us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535906.223644:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788535906.223684:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569381248:0@lo:400:kworker.0 00000040:00080000:3.0:1788535906.348784:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788535906.349558:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788535906.476369:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535906.732650:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535906.732690:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569382912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535906.732758:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535906.733012:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569382912 00000100:00100000:2.0:1788535906.733021:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569382912 00000100:00100000:2.0:1788535906.733079:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788535906.733089:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569382912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788535906.733118:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535906.733187:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569382912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535906.733195:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788535906.733361:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535906.733371:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569383040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535906.733401:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535906.733619:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569383040 00000100:00100000:3.0:1788535906.733624:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569383040 00000100:00100000:3.0:1788535906.733656:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788535906.733662:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875415569383040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535906.733674:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535906.733706:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875415569383040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535906.733712:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788535906.733747:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569382912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535906.733786:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900485d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569383040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788535907.500331:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535907.756424:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569383168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535907.756491:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535907.756661:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569383168 00000100:00100000:3.0:1788535907.756670:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569383168 00000100:00100000:3.0:1788535907.756730:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788535907.756739:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569383168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535907.756767:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535907.756969:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535907.756979:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569383296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535907.757019:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535907.757047:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569383296 00000100:00100000:2.0:1788535907.757051:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569383296 00000100:00100000:2.0:1788535907.757193:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788535907.757204:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569383296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788535907.757232:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535907.757265:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569383296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535907.757312:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569383168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 574us (821us total) trans 0 rc 0/0 00010000:00080000:1.0:1788535907.757556:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487467800 x1875415569383168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535907.757574:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569383168:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788535907.757916:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488082300 x1875415569383296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535907.757950:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569383296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535907.758070:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788535907.758196:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788535908.268516:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535908.268539:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569383424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788535908.268613:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535908.268742:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569383424 00000100:00100000:2.0:1788535908.268750:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569383424 00000100:00100000:2.0:1788535908.268811:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788535908.268819:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569383424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788535908.268850:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788535908.268906:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569383424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535908.268912:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788535908.269077:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569383424:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535908.524521:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535908.780562:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569383552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535908.780632:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535908.780798:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569383552 00000100:00100000:0.0:1788535908.780806:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569383552 00000100:00100000:0.0:1788535908.780861:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788535908.780871:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569383552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788535908.780907:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788535908.780980:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569383552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535908.780987:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788535908.781569:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569383552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788535909.242387:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535909.242444:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535909.242473:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535909.242514:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535909.242538:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535909.242558:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535909.242589:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548324992 00000100:00100000:0.0:1788535909.242598:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548324992 00000100:00100000:0.0:1788535909.242651:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548325504 00000100:00100000:0.0:1788535909.242654:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548325504 00000100:00100000:0.0:1788535909.242666:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548325120 00000100:00100000:0.0:1788535909.242668:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548325120 00000100:00100000:0.0:1788535909.242679:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548325376 00000100:00100000:0.0:1788535909.242681:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548325376 00000100:00100000:0.0:1788535909.242696:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:0.0:1788535909.242706:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548324992:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535909.242776:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548324992:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535909.242799:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:1.0:1788535909.242815:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548325248 00000100:00100000:0.0:1788535909.242816:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:1.0:1788535909.242819:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548325248 00000100:00100000:0.0:1788535909.242822:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548325504:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535909.242848:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:0.0:1788535909.242849:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548325504:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535909.242855:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548325248:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535909.242867:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:0.0:1788535909.242880:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:1.0:1788535909.242881:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548325248:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535909.242886:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548325120:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535909.242887:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:0.0:1788535909.242907:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548325120:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 21us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535909.242912:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:0.0:1788535909.242932:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:3.0:1788535909.243059:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548324864 00000100:00100000:3.0:1788535909.243066:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548324864 00000100:00100000:3.0:1788535909.243107:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 365 00000100:00100000:3.0:1788535909.243117:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548324864:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:2.0:1788535909.243129:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535909.243135:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535909.243137:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535909.243184:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548324864:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535909.243199:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 365 00000100:00100000:0.0:1788535909.243548:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548325376:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535909.243595:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548325376:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 656us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535909.247091:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000001:00080000:3.0:1788535909.301492:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1788535909.548376:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535910.572299:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535911.348391:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569383808:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.348467:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535911.348532:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569384320:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.348570:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535911.348592:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569384832:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.348613:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535911.348641:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788535911.348647:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569383936:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.348679:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535911.348703:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569384448:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.348723:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535911.348738:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569384960:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.348758:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535911.349280:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569383680:0@lo:400:kworker.0 00000100:00100000:0.0:1788535911.349321:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535911.349358:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569384192:0@lo:400:kworker.0 00000100:00100000:0.0:1788535911.349390:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535911.349412:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569384704:0@lo:400:kworker.0 00000100:00100000:0.0:1788535911.349457:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535911.349476:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569385216:0@lo:400:kworker.0 00000100:00100000:0.0:1788535911.349495:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535911.349513:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788535911.349519:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569384064:0@lo:400:kworker.0 00000100:00100000:0.0:1788535911.349541:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535911.349553:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569384576:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.349567:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569383808 00000100:00100000:2.0:1788535911.349575:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569383808 00000100:00100000:0.0:1788535911.349576:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535911.349598:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569385088:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.349619:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569384320 00000100:00100000:0.0:1788535911.349622:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535911.349624:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569384320 00000100:00100000:2.0:1788535911.349654:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569384832 00000100:00100000:2.0:1788535911.349657:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569384832 00000100:00100000:0.0:1788535911.349660:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569383936 00000100:00100000:0.0:1788535911.349666:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569383936 00000100:00100000:2.0:1788535911.349673:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569384448 00000100:00100000:2.0:1788535911.349677:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569384448 00000100:00100000:0.0:1788535911.349693:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569384192 00000100:00100000:2.0:1788535911.349697:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569384960 00000100:00100000:0.0:1788535911.349697:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569384192 00000100:00100000:2.0:1788535911.349703:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569384960 00000100:00100000:0.0:1788535911.349721:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788535911.349732:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569383936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.349734:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569384064 00000100:00100000:2.0:1788535911.349739:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569384064 00000100:00100000:2.0:1788535911.349755:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788535911.349763:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569383808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535911.349788:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569383936:12345-0@lo:400:kworker.0 Request processed in 58us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535911.349796:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788535911.349808:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569383808:12345-0@lo:400:kworker.0 Request processed in 45us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535911.349819:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788535911.349820:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788535911.349833:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569384192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.349842:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788535911.349851:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569384320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535911.349872:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569384192:12345-0@lo:400:kworker.0 Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535911.349880:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788535911.349891:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569384320:12345-0@lo:400:kworker.0 Request processed in 41us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535911.349900:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788535911.349918:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788535911.349928:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788535911.349932:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569384832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.349940:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569384448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535911.349988:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569384832:12345-0@lo:400:kworker.0 Request processed in 61us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535911.349990:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569384448:12345-0@lo:400:kworker.0 Request processed in 53us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535911.350001:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788535911.350057:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569383680 00000100:00100000:3.0:1788535911.350062:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569383680 00000100:00100000:3.0:1788535911.350090:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788535911.350095:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569383680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.350131:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569383680:12345-0@lo:400:kworker.0 Request processed in 35us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535911.350137:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788535911.350230:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569383936:0@lo:400:kworker.0 00010000:00080000:3.0:1788535911.350255:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e562a00 x1875415569384448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535911.350265:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569384448:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.350276:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569383808:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.350286:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569384320:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.350295:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569384832:0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.350340:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569384704 00000100:00100000:3.0:1788535911.350343:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569384704 00000100:00100000:3.0:1788535911.350363:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569385216 00000100:00100000:3.0:1788535911.350365:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569385216 00000100:00100000:3.0:1788535911.350376:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569384576 00000100:00100000:3.0:1788535911.350378:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569384576 00000100:00100000:3.0:1788535911.350388:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569385088 00000100:00100000:3.0:1788535911.350390:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569385088 00000100:00100000:3.0:1788535911.350403:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788535911.350409:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569384704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.350439:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569384704:12345-0@lo:400:kworker.0 Request processed in 30us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535911.350444:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788535911.350455:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788535911.350460:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569385216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.350485:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569385216:12345-0@lo:400:kworker.0 Request processed in 25us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535911.350490:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788535911.350500:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788535911.350512:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569384576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.350539:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569384576:12345-0@lo:400:kworker.0 Request processed in 28us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535911.350544:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788535911.350555:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788535911.350560:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569385088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535911.350583:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569385088:12345-0@lo:400:kworker.0 Request processed in 23us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535911.350590:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788535911.358360:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788535911.358406:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788535911.358435:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569384960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.358546:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569384960:12345-0@lo:400:kworker.0 Request processed in 120us (9775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535911.358553:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788535911.358566:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788535911.358574:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569384064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.358604:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569384064:12345-0@lo:400:kworker.0 Request processed in 32us (9063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535911.358625:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:2.0:1788535911.358650:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535911.358654:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535911.358657:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535911.358660:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788535911.358699:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e756300 x1875415569384960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535911.358714:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569384960:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.358787:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569384064:0@lo:400:kworker.0 00010000:00080000:2.0:1788535911.358800:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e561c00 x1875415569384576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535911.358809:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569384576:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.358821:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569385088:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.358830:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569383680:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.358840:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569384192:0@lo:400:kworker.0 00010000:00080000:2.0:1788535911.358851:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e563100 x1875415569384704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535911.358859:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569384704:0@lo:400:kworker.0 00000100:00100000:2.0:1788535911.358869:0:3663:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788535911.358874:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff900487a80e00, transno 4294967301 00000100:00100000:2.0:1788535911.358892:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569385216:0@lo:400:kworker.0 00010000:00010000:0.0:1788535911.597175:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535911.852485:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569385472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535911.852552:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535911.852563:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569385344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788535911.852615:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535911.852680:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569385472 00000100:00100000:0.0:1788535911.852687:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569385472 00000100:00100000:0.0:1788535911.852733:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569385344 00000100:00100000:0.0:1788535911.852736:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569385344 00000100:00100000:0.0:1788535911.852753:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788535911.852761:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569385472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535911.852788:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535911.852839:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569385472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535911.852846:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788535911.852862:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788535911.852868:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569385344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535911.852878:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535911.852918:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569385344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535911.852924:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788535911.852952:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569385344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535911.853043:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569385472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788535912.621046:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535912.878751:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569385600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788535912.878832:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535912.879128:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569385600 00000100:00100000:2.0:1788535912.879137:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569385600 00000100:00100000:2.0:1788535912.879224:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788535912.879232:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569385600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788535912.879260:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535912.879314:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569385600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535912.879321:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1788535912.879435:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488080e00 x1875415569385600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535912.879453:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569385600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788535912.882909:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788535912.882937:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569385728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535912.883018:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535912.883414:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569385728 00000100:00100000:3.0:1788535912.883423:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569385728 00000100:00100000:3.0:1788535912.883478:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788535912.883487:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569385728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535912.883508:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535912.883570:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569385728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535912.883578:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1788535912.883669:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487a80e00 x1875415569385728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535912.883690:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569385728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535913.388856:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569385856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788535913.388941:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535913.390320:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569385856 00000100:00100000:0.0:1788535913.390332:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569385856 00000100:00100000:0.0:1788535913.390395:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788535913.390421:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569385856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788535913.390465:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535913.391834:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569385856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1425us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535913.391859:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788535913.393473:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569385856:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788535913.644303:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535913.900507:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535913.900531:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569385984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535913.900605:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535913.900776:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569385984 00000100:00100000:3.0:1788535913.900784:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569385984 00000100:00100000:3.0:1788535913.901788:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788535913.901802:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569385984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535913.901862:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788535913.901953:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569385984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535913.901960:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788535913.902315:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569385984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535914.365285:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535914.365338:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535914.365368:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535914.365404:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535914.365428:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535914.365452:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535914.365528:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548325760 00000100:00100000:3.0:1788535914.365539:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548325760 00000100:00100000:3.0:1788535914.365605:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548326272 00000100:00100000:3.0:1788535914.365608:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548326272 00000100:00100000:3.0:1788535914.365622:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548325888 00000100:00100000:3.0:1788535914.365624:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548325888 00000100:00100000:3.0:1788535914.365638:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548326144 00000100:00100000:3.0:1788535914.365640:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548326144 00000100:00100000:3.0:1788535914.365657:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:3.0:1788535914.365666:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548325760:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535914.365733:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548325760:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535914.365740:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:3.0:1788535914.365757:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:3.0:1788535914.365764:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548326272:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535914.365787:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548326272:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535914.365792:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:3.0:1788535914.365803:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:3.0:1788535914.365809:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548325888:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535914.365829:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548325888:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 21us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535914.365835:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:3.0:1788535914.365844:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:3.0:1788535914.365850:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548326144:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535914.365868:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548326144:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 18us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535914.365899:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:3.0:1788535914.366027:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548325632 00000100:00100000:3.0:1788535914.366031:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548325632 00000100:00100000:3.0:1788535914.366056:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 367 00000100:00100000:3.0:1788535914.366062:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548325632:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535914.366091:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548325632:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535914.366097:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 367 00000100:00100000:3.0:1788535914.366251:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548326016 00000100:00100000:3.0:1788535914.366256:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548326016 00000100:00100000:3.0:1788535914.366286:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:3.0:1788535914.366293:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548326016:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535914.366367:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548326016:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535914.366376:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00080000:2.0:1788535914.366585:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535914.366590:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535914.366592:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788535914.668826:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535915.696092:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535916.461253:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569386496:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.461257:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569386368:0@lo:400:kworker.0 00000100:00100000:0.0:1788535916.461312:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569386240:0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.461384:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569386112:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.462132:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535916.462266:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569386880:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.462299:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535916.462324:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569387392:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.462346:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535916.462395:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569386368 00000100:00100000:3.0:1788535916.462403:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569386368 00000100:00100000:3.0:1788535916.462446:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788535916.462454:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569386368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.462514:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569386368:12345-0@lo:400:kworker.0 Request processed in 60us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.462521:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788535916.462609:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569386880 00000100:00100000:3.0:1788535916.462612:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569386880 00000100:00100000:3.0:1788535916.462649:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569387392 00000100:00100000:3.0:1788535916.462652:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569387392 00000100:00100000:3.0:1788535916.462671:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788535916.462677:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569386880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.462707:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569386880:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.462713:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788535916.462723:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788535916.462729:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569387392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.462753:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569387392:12345-0@lo:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.462759:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1788535916.462847:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535916.462896:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569386368:0@lo:400:kworker.0 00010000:00080000:3.0:1788535916.462911:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048816b480 x1875415569386880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535916.463002:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535916.463023:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569386752:0@lo:400:kworker.0 00000100:00100000:0.0:1788535916.463048:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535916.463065:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569387264:0@lo:400:kworker.0 00000100:00100000:0.0:1788535916.463084:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535916.463119:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569386240 00000100:00100000:0.0:1788535916.463123:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569386240 00000100:00100000:0.0:1788535916.463157:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569386752 00000100:00100000:0.0:1788535916.463161:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569386752 00000100:00100000:0.0:1788535916.463181:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569387264 00000100:00100000:0.0:1788535916.463184:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569387264 00000100:00100000:3.0:1788535916.463187:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569386880:0@lo:400:kworker.0 00000100:00100000:0.0:1788535916.463197:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00010000:00080000:3.0:1788535916.463202:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488169500 x1875415569387392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535916.463202:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569386240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.463211:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569387392:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.463246:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788535916.463247:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569386240:12345-0@lo:400:kworker.0 Request processed in 44us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.463253:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569386752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535916.463253:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788535916.463280:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569386752:12345-0@lo:400:kworker.0 Request processed in 28us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.463286:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788535916.463297:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788535916.463302:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569387264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.463326:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569387264:12345-0@lo:400:kworker.0 Request processed in 24us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.463332:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:3.0:1788535916.463367:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535916.464250:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535916.464289:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569387008:0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.464319:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535916.464341:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569387520:0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.464363:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535916.464400:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569387008 00000100:00100000:1.0:1788535916.464406:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569387008 00000100:00100000:1.0:1788535916.464684:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569387520 00000100:00100000:1.0:1788535916.464688:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569387520 00000100:00100000:1.0:1788535916.464707:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788535916.464715:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569387008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.464924:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569387008:12345-0@lo:400:kworker.0 Request processed in 210us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.464932:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788535916.465198:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788535916.465207:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569387520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.465239:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569387520:12345-0@lo:400:kworker.0 Request processed in 34us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.465245:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788535916.465268:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535916.465271:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535916.465296:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048816a300 x1875415569387008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535916.465309:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569387008:0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.465318:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569387520:0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.465359:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569386240:0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.465370:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569386752:0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.465380:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569387264:0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.471214:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569386496 00000100:00100000:3.0:1788535916.471229:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569386496 00000100:00100000:3.0:1788535916.471289:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788535916.471299:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569386496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535916.471391:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569386496:12345-0@lo:400:kworker.0 Request processed in 93us (7143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.471398:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788535916.471454:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569386496:0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.473631:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535916.473826:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569386624:0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.473861:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535916.473895:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569387136:0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.473928:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535916.474107:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569387648:0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.474129:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535916.474490:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569387136 00000100:00100000:1.0:1788535916.474499:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569387136 00000100:00100000:1.0:1788535916.474561:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569387648 00000100:00100000:1.0:1788535916.474564:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569387648 00000100:00100000:1.0:1788535916.474586:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788535916.474595:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569387136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.474651:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569387136:12345-0@lo:400:kworker.0 Request processed in 57us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.474657:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788535916.474673:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788535916.474679:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569387648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.474809:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569387648:12345-0@lo:400:kworker.0 Request processed in 130us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.474816:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788535916.474837:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569386624 00000100:00100000:1.0:1788535916.474840:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569386624 00000100:00100000:1.0:1788535916.474868:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788535916.474884:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569386624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535916.474927:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569386624:12345-0@lo:400:kworker.0 Request processed in 34us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535916.474934:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788535916.475409:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535916.475413:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535916.475495:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e14c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569386624:0@lo:400:kworker.0 00010000:00080000:2.0:1788535916.475511:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488169880 x1875415569387136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535916.475521:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569387136:0@lo:400:kworker.0 00000100:00100000:2.0:1788535916.475533:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569387648:0@lo:400:kworker.0 00000100:00100000:0.0:1788535916.475613:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569386112 00000100:00100000:0.0:1788535916.475618:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569386112 00000100:00100000:0.0:1788535916.475704:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788535916.475713:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3662:x1875415569386112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535916.475769:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3662:x1875415569386112:12345-0@lo:400:kworker.0 Request processed in 58us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535916.475798:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788535916.475867:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569386112:0@lo:400:kworker.0 00000040:00080000:0.0:1788535916.588810:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788535916.589523:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788535916.717284:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535916.972623:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004880c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569387776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535916.972693:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535916.972883:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569387776 00000100:00100000:0.0:1788535916.972892:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569387776 00000100:00100000:0.0:1788535916.972939:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788535916.972949:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569387776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535916.972977:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535916.973031:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569387776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535916.973038:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788535916.973444:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004880c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569387776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535916.974068:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535916.974080:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569387904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535916.974132:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535916.974209:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569387904 00000100:00100000:3.0:1788535916.974215:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569387904 00000100:00100000:3.0:1788535916.974241:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788535916.974248:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569387904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535916.974262:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535916.974292:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569387904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535916.974298:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788535916.974573:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569387904:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788535917.740355:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535917.996472:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569388032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535917.996540:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535917.996790:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569388032 00000100:00100000:3.0:1788535917.996800:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569388032 00000100:00100000:3.0:1788535917.996856:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788535917.996875:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569388032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535917.996904:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535917.996950:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569388032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535917.996957:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1788535917.997048:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e560a80 x1875415569388032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535917.997067:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569388032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535917.997829:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569388160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535917.997898:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535917.997963:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569388160 00000100:00100000:1.0:1788535917.997968:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569388160 00000100:00100000:1.0:1788535917.998012:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788535917.998020:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569388160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788535917.998033:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535918.003707:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569388160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5676us (5796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535918.003722:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1788535918.004496:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb33480 x1875415569388160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535918.004523:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569388160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535918.514577:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569388288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788535918.514647:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535918.514786:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569388288 00000100:00100000:1.0:1788535918.514796:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569388288 00000100:00100000:1.0:1788535918.514854:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788535918.514873:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569388288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788535918.514917:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788535918.514995:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569388288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535918.515002:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788535918.515394:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569388288:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535918.767903:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535919.024315:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569388416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535919.024402:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535919.024752:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569388416 00000100:00100000:3.0:1788535919.024761:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569388416 00000100:00100000:3.0:1788535919.024811:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788535919.024821:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569388416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535919.024863:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788535919.024918:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569388416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535919.024924:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788535919.025188:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569388416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535919.487268:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535919.487317:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535919.487352:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535919.487382:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548326528 00000100:00100000:3.0:1788535919.487392:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548326528 00000100:00100000:3.0:1788535919.487446:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548326656 00000100:00100000:3.0:1788535919.487449:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548326656 00000100:00100000:3.0:1788535919.487473:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:3.0:1788535919.487483:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548326528:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535919.487558:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548326528:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 77us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535919.487566:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:3.0:1788535919.487584:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:3.0:1788535919.487590:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548326656:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535919.487616:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548326656:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535919.487622:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00080000:3.0:1788535919.487728:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535919.487733:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535919.489251:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548326400 00000100:00100000:1.0:1788535919.489264:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548326400 00000100:00100000:1.0:1788535919.489317:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 369 00000100:00100000:1.0:1788535919.489326:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548326400:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535919.489386:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548326400:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 61us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535919.489393:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 369 00000100:00100000:3.0:1788535919.499515:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535919.499559:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535919.499592:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535919.499742:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548327040 00000100:00100000:2.0:1788535919.499761:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548327040 00000100:00100000:2.0:1788535919.499825:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548326912 00000100:00100000:2.0:1788535919.499828:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548326912 00000100:00100000:2.0:1788535919.499863:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:2.0:1788535919.499874:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548327040:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535919.499960:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548327040:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (400us total) trans 0 rc 0/0 00000100:00080000:3.0:1788535919.500253:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788535919.500257:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535919.500286:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:3.0:1788535919.500296:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548326912:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535919.500327:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548326912:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535919.500348:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:2.0:1788535919.500658:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:1.0:1788535919.500937:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548326784 00000100:00100000:1.0:1788535919.500944:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548326784 00000100:00100000:1.0:1788535919.501004:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1788535919.501012:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2398:x1875415548326784:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1788535919.501033:0:8448:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc66b 00000100:00080000:1.0:1788535919.501041:0:8448:0:(import.c:65:import_set_state_nolock()) ffff900487a53000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788535919.501433:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1788535919.501560:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+2:2398:x1875415548326784:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 548us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535919.501568:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00010000:00010000:0.0:1788535919.501662:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788535919.501826:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788535919.788447:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535920.822520:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535921.580629:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569388544:0@lo:400:kworker.0 00000100:00100000:2.0:1788535921.580662:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569388800:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.580703:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535921.580709:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535921.580762:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569389056:0@lo:400:kworker.0 00000100:00100000:1.0:1788535921.580780:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569388928:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.580789:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535921.580819:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569389568:0@lo:400:kworker.0 00000100:00100000:1.0:1788535921.580846:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535921.580877:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535921.580889:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569389440:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.580903:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569390080:0@lo:400:kworker.0 00000100:00100000:1.0:1788535921.580921:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535921.580942:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569388928 00000100:00100000:0.0:1788535921.580949:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569388928 00000100:00100000:3.0:1788535921.580987:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569389568 00000100:00100000:3.0:1788535921.580993:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569389568 00000100:00100000:0.0:1788535921.581013:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788535921.581025:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569388928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.581038:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569389440 00000100:00100000:3.0:1788535921.581042:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569389440 00000100:00100000:3.0:1788535921.581066:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788535921.581073:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569389568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535921.589468:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569389312:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.590478:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569388928:12345-0@lo:400:kworker.0 Request processed in 9451us (9635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.590492:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788535921.591334:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569388800 00000100:00100000:0.0:1788535921.591345:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569388800 00000100:00100000:0.0:1788535921.591379:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569389056 00000100:00100000:0.0:1788535921.591382:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569389056 00000100:00100000:0.0:1788535921.591397:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788535921.591641:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569388800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.591711:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569388800:12345-0@lo:400:kworker.0 Request processed in 307us (11002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.591718:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788535921.591733:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788535921.591740:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569389056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.591787:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569389056:12345-0@lo:400:kworker.0 Request processed in 48us (10999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.591794:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788535921.591818:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569388544 00000100:00100000:0.0:1788535921.591822:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569388544 00000100:00100000:0.0:1788535921.591867:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788535921.591874:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569388544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.591906:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569388544:12345-0@lo:400:kworker.0 Request processed in 32us (11205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.591912:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788535921.591961:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788535921.591970:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569389440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.592012:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569389440:12345-0@lo:400:kworker.0 Request processed in 44us (11091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.592018:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788535921.592206:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535921.592253:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569388544:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.592267:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569389056:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.592299:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569390080 00000100:00100000:0.0:1788535921.592302:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569390080 00000100:00100000:0.0:1788535921.592324:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788535921.592330:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569390080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.592366:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569390080:12345-0@lo:400:kworker.0 Request processed in 37us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.592372:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788535921.592408:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569390080:0@lo:400:kworker.0 00000100:00080000:0.0:1788535921.592447:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535921.592450:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535921.592467:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569388672:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.592498:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535921.596593:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569389568:12345-0@lo:400:kworker.0 Request processed in 15508us (15704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.596609:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:3.0:1788535921.596675:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487521500 x1875415569389568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535921.596691:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569389568:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.596762:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569388672 00000100:00100000:3.0:1788535921.596769:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569388672 00000100:00100000:3.0:1788535921.596805:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788535921.596812:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569388672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.596873:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569388672:12345-0@lo:400:kworker.0 Request processed in 61us (4374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.596880:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788535921.597183:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569388672:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.597195:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569389184:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.597230:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535921.597251:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569389696:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.597273:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535921.597310:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569389184 00000100:00100000:0.0:1788535921.597314:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569389184 00000100:00100000:0.0:1788535921.597345:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569389696 00000100:00100000:0.0:1788535921.597348:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569389696 00000100:00100000:0.0:1788535921.597367:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788535921.597373:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569389184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.597409:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569389184:12345-0@lo:400:kworker.0 Request processed in 36us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.597416:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788535921.597427:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788535921.597433:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569389696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.597456:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569389696:12345-0@lo:400:kworker.0 Request processed in 23us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.597461:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:0.0:1788535921.597477:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535921.597495:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569389184:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.600163:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569389696:0@lo:400:kworker.0 00010000:00080000:1.0:1788535921.601309:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487521c00 x1875415569389440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535921.601324:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569389440:0@lo:400:kworker.0 00000100:00100000:1.0:1788535921.601335:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569389952:0@lo:400:kworker.0 00000100:00100000:1.0:1788535921.601396:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535921.601513:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569388928:0@lo:400:kworker.0 00000100:00100000:2.0:1788535921.602286:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535921.602324:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569389824:0@lo:400:kworker.0 00000100:00100000:2.0:1788535921.602349:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535921.602393:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569388800:0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.602480:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569389312 00000100:00100000:3.0:1788535921.602488:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569389312 00000100:00100000:3.0:1788535921.602550:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569389824 00000100:00100000:3.0:1788535921.602554:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569389824 00000100:00100000:3.0:1788535921.602575:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788535921.602583:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569389312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.602647:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569389312:12345-0@lo:400:kworker.0 Request processed in 65us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.602655:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788535921.602673:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788535921.602679:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569389824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535921.602704:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569389824:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535921.602710:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:2.0:1788535921.602844:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788535921.602868:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900487522300 x1875415569389312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535921.602878:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569389312:0@lo:400:kworker.0 00010000:00080000:2.0:1788535921.602887:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e70c380 x1875415569389824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535921.602895:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569389824:0@lo:400:kworker.0 00000100:00100000:0.0:1788535921.603672:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569389952 00000100:00100000:0.0:1788535921.603680:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569389952 00000100:00100000:0.0:1788535921.603738:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788535921.603746:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569389952:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788535921.603883:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788535921.604462:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569389952:12345-0@lo:400:kworker.0 Request processed in 715us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535921.604475:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788535921.607896:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569389952:0@lo:400:kworker.0 00010000:00010000:0.0:1788535921.842240:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535922.092354:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535922.092377:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569390208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535922.092445:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535922.092685:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569390208 00000100:00100000:0.0:1788535922.092692:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569390208 00000100:00100000:0.0:1788535922.092738:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788535922.092747:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569390208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535922.092771:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535922.092821:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569390208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535922.092828:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788535922.093029:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569390208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535922.093207:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788535922.100078:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569390336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535922.100203:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535922.100500:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569390336 00000100:00100000:0.0:1788535922.100509:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569390336 00000100:00100000:0.0:1788535922.100557:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788535922.100566:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569390336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535922.100590:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535922.100642:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569390336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535922.100649:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788535922.101280:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569390336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788535922.860807:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535923.116475:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569390464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535923.116541:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535923.116655:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569390464 00000100:00100000:3.0:1788535923.116663:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569390464 00000100:00100000:3.0:1788535923.116729:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788535923.116740:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569390464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535923.116767:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535923.116824:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569390464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535923.116840:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788535923.116900:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788535923.116928:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e562300 x1875415569390464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535923.116946:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569390464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535923.117372:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e70c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569390592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535923.117405:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535923.117509:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569390592 00000100:00100000:2.0:1788535923.117514:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569390592 00000100:00100000:2.0:1788535923.117553:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788535923.117561:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569390592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788535923.117572:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788535923.117650:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535923.118525:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569390592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 961us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535923.118548:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1788535923.127743:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059e70c380 x1875415569390592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535923.127770:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e70c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569390592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535923.628356:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535923.630919:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569390720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788535923.632137:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535923.632816:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569390720 00000100:00100000:0.0:1788535923.632835:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569390720 00000100:00100000:0.0:1788535923.632895:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788535923.632904:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569390720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788535923.633049:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535923.633117:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569390720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 214us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535923.633125:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788535923.633247:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569390720:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535923.886740:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535924.142771:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569390848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535924.142857:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535924.143042:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569390848 00000100:00100000:3.0:1788535924.143051:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569390848 00000100:00100000:3.0:1788535924.143270:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788535924.143282:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569390848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535924.143316:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788535924.143397:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569390848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535924.143405:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788535924.143466:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059e562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569390848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535924.604745:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535924.604797:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535924.604840:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535924.604895:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535924.604922:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535924.604925:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548327424 00000100:00100000:2.0:1788535924.604936:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548327424 00000100:00100000:3.0:1788535924.604961:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548327680 00000100:00100000:3.0:1788535924.604967:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548327680 00000100:00100000:3.0:1788535924.605000:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548327296 00000100:00100000:3.0:1788535924.605003:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548327296 00000100:00100000:2.0:1788535924.605007:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548327552 00000100:00100000:2.0:1788535924.605012:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548327552 00000100:00100000:3.0:1788535924.605027:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:0.0:1788535924.605172:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548327168 00000100:00100000:0.0:1788535924.605177:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548327168 00000100:00100000:0.0:1788535924.605208:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 371 00000100:00100000:0.0:1788535924.605216:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548327168:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535924.605281:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548327168:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 65us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535924.605288:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 371 00000100:00100000:3.0:1788535924.605905:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548327424:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535924.605964:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548327424:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 928us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.610739:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:2.0:1788535924.610763:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548327680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535924.610847:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548327680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 97us (6006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.610855:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:2.0:1788535924.610876:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:2.0:1788535924.610882:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548327296:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535924.610907:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548327296:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (6012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.610912:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:2.0:1788535924.610924:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:2.0:1788535924.610930:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548327552:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535924.610950:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548327552:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 21us (6030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535924.610972:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00080000:2.0:1788535924.610998:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535924.611004:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535924.618324:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00010000:00010000:0.0:1788535924.910134:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788535925.172289:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:3.0:1788535925.172298:0:9525:0:(genops.c:885:class_export_put()) final put ffff900487a55000/b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:1.0:1788535925.172373:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff900487a55000/b9ef506c-5095-4495-a34a-e3b5845d008a for lustre-OST0001 00000020:00000080:1.0:1788535925.172423:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900487a53000 for lustre-OST0001 00010000:00010000:0.0:1788535925.942912:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535926.700635:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569390976:0@lo:400:kworker.0 00000100:00100000:3.0:1788535926.700771:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.700927:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569391104:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.700959:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.701004:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569391616:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.701034:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.701057:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569392128:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.701076:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.701096:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788535926.701101:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569391488:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.701124:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.701140:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569392000:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.701181:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.701200:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569392512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.701233:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535926.701482:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569391360:0@lo:400:kworker.0 00000100:00100000:1.0:1788535926.701521:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535926.701545:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569391872:0@lo:400:kworker.0 00000100:00100000:3.0:1788535926.703141:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569391104 00000100:00100000:3.0:1788535926.703176:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569391104 00000100:00100000:3.0:1788535926.703230:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569391616 00000100:00100000:3.0:1788535926.703240:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569391616 00000100:00100000:3.0:1788535926.703264:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569392128 00000100:00100000:3.0:1788535926.703268:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569392128 00000100:00100000:3.0:1788535926.703279:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569391360 00000100:00100000:3.0:1788535926.703290:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569391360 00000100:00100000:3.0:1788535926.703309:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788535926.703317:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569391104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535926.703383:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569391104:12345-0@lo:400:kworker.0 Request processed in 67us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535926.703391:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788535926.703408:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788535926.703414:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569391616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535926.703439:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569391616:12345-0@lo:400:kworker.0 Request processed in 26us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535926.703444:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788535926.703453:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788535926.703458:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569392128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535926.703493:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569392128:12345-0@lo:400:kworker.0 Request processed in 35us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535926.703498:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788535926.703508:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788535926.703514:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569391360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535926.703543:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569391360:12345-0@lo:400:kworker.0 Request processed in 30us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535926.703549:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788535926.704379:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569391104:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.704392:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569391616:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.704402:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569392128:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.704444:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569391232:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.704549:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.704569:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569391744:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.704591:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.704607:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569392256:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.704627:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.704657:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569391744 00000100:00100000:0.0:1788535926.704662:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569391744 00000100:00100000:0.0:1788535926.704687:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569392256 00000100:00100000:0.0:1788535926.704690:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569392256 00000100:00100000:0.0:1788535926.704837:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788535926.704852:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569391744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.704895:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569391744:12345-0@lo:400:kworker.0 Request processed in 43us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.704902:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788535926.704916:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788535926.704922:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569392256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.704945:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569392256:12345-0@lo:400:kworker.0 Request processed in 24us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.704951:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788535926.704968:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569392000 00000100:00100000:0.0:1788535926.704972:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569392000 00000100:00100000:0.0:1788535926.704994:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569392512 00000100:00100000:0.0:1788535926.704996:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569392512 00000100:00100000:0.0:1788535926.705012:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788535926.705018:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569392000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.705051:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569392000:12345-0@lo:400:kworker.0 Request processed in 33us (3870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.705056:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788535926.705067:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788535926.705073:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569392512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.705099:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569392512:12345-0@lo:400:kworker.0 Request processed in 27us (3866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.705105:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788535926.705127:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569391488 00000100:00100000:0.0:1788535926.705131:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569391488 00000100:00100000:0.0:1788535926.705165:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569391232 00000100:00100000:0.0:1788535926.705168:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569391232 00000100:00100000:0.0:1788535926.705193:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788535926.705199:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569391488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.707435:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569391488:12345-0@lo:400:kworker.0 Request processed in 2228us (6302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.707448:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788535926.708369:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788535926.708384:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569391232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.708439:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569391232:12345-0@lo:400:kworker.0 Request processed in 60us (3890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.708445:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788535926.709432:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569391232:0@lo:400:kworker.0 00010000:00080000:0.0:1788535926.709453:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb04700 x1875415569391744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535926.709465:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569391744:0@lo:400:kworker.0 00010000:00080000:0.0:1788535926.709584:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb06300 x1875415569392256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535926.709594:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569392256:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.709655:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569391488:0@lo:400:kworker.0 00010000:00080000:0.0:1788535926.709666:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb07100 x1875415569392000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535926.709675:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569392000:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.709686:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569392512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.709712:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.709769:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569392384:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.709821:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535926.709855:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569391360:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.709879:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569391872 00000100:00100000:0.0:1788535926.709885:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569391872 00000100:00100000:0.0:1788535926.709925:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569392384 00000100:00100000:0.0:1788535926.709928:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569392384 00000100:00100000:0.0:1788535926.709946:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788535926.709954:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569391872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.709994:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569391872:12345-0@lo:400:kworker.0 Request processed in 41us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.710001:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788535926.710014:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788535926.710019:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569392384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.710045:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569392384:12345-0@lo:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535926.710051:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1788535926.710079:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb05180 x1875415569391872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535926.710088:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569391872:0@lo:400:kworker.0 00000100:00100000:0.0:1788535926.710096:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569392384:0@lo:400:kworker.0 00000100:00100000:2.0:1788535926.711522:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569390976 00000100:00100000:2.0:1788535926.711533:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569390976 00000100:00080000:2.0:1788535926.711554:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535926.711558:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535926.711561:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535926.711564:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535926.711602:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788535926.711610:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569390976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535926.711684:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569390976:12345-0@lo:400:kworker.0 Request processed in 74us (10912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535926.711691:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788535926.711728:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569390976:0@lo:400:kworker.0 00000040:00080000:0.0:1788535926.830889:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788535926.854442:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788535926.957398:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535927.217674:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535927.217740:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569392640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535927.217827:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535927.218076:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569392640 00000100:00100000:2.0:1788535927.218085:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569392640 00000100:00100000:0.0:1788535927.218242:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569392768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535927.218269:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535927.218403:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569392768 00000100:00100000:2.0:1788535927.218407:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569392768 00000100:00100000:2.0:1788535927.218426:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788535927.218434:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569392640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788535927.218459:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535927.218509:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569392640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535927.218516:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788535927.218532:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788535927.218545:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569392768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788535927.218554:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535927.218580:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569392768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535927.218586:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788535927.218623:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569392768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535927.218681:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569392640:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788535927.984223:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535928.236398:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569393024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535928.236466:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535928.236522:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569392896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788535928.236558:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535928.236660:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569393024 00000100:00100000:3.0:1788535928.236664:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569392896 00000100:00100000:3.0:1788535928.236668:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569392896 00000100:00100000:2.0:1788535928.236668:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569393024 00000100:00080000:0.0:1788535928.236738:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535928.236776:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788535928.236800:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569393024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535928.236829:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535928.236892:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e14d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569393024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535928.236899:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788535928.236927:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788535928.236933:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569392896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788535928.236943:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535928.236967:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569392896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535928.236972:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1788535928.237035:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004883c4e00 x1875415569393024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535928.237052:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569393024:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788535928.237063:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb06300 x1875415569392896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535928.237074:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569392896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535928.748401:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569393152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535928.748481:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535928.748621:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569393152 00000100:00100000:3.0:1788535928.748629:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569393152 00000100:00100000:3.0:1788535928.748682:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788535928.748690:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569393152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788535928.748720:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788535928.748769:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569393152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535928.748776:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788535928.748854:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569393152:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535929.004369:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535929.260453:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569393280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535929.260533:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535929.261395:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569393280 00000100:00100000:3.0:1788535929.261405:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569393280 00000100:00100000:3.0:1788535929.261465:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788535929.261475:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569393280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535929.261511:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788535929.261582:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569393280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535929.261589:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788535929.261630:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569393280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535929.729651:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535929.729694:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535929.729720:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535929.729738:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535929.729761:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535929.729808:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548328064 00000100:00100000:1.0:1788535929.729818:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548328064 00000100:00100000:1.0:1788535929.729871:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548328320 00000100:00100000:1.0:1788535929.729874:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548328320 00000100:00100000:1.0:1788535929.729887:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548327936 00000100:00100000:1.0:1788535929.729890:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548327936 00000100:00100000:1.0:1788535929.729901:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548328192 00000100:00100000:1.0:1788535929.729904:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548328192 00000100:00100000:1.0:1788535929.729920:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 248 00000100:00100000:1.0:1788535929.729928:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548328064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535929.729997:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548328064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535929.730005:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 248 00000100:00100000:1.0:1788535929.730031:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:1.0:1788535929.730037:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548328320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535929.730064:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548328320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535929.730070:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:1.0:1788535929.730081:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 250 00000100:00100000:1.0:1788535929.730087:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548327936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535929.730110:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548327936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535929.730116:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 250 00000100:00100000:1.0:1788535929.730127:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 251 00000100:00100000:1.0:1788535929.730134:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548328192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535929.730180:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548328192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 46us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535929.730186:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 251 00000100:00080000:1.0:1788535929.730209:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535929.730214:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535929.732164:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548327808 00000100:00100000:3.0:1788535929.732177:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548327808 00000100:00100000:3.0:1788535929.732243:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 373 00000100:00100000:3.0:1788535929.732252:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548327808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535929.732324:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548327808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535929.732331:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 373 00010000:00010000:0.0:1788535930.028858:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788535930.106435:0:14072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 11:32:08 (1788535928) 00010000:00010000:0.0:1788535931.052647:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535931.678133:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535931.678295:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548328448 00000100:00100000:1.0:1788535931.678305:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548328448 00000100:00100000:1.0:1788535931.678381:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1788535931.678393:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:11102:x1875415548328448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535931.678411:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535931.678433:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fc00/0xe79af2f39bbdc74b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655347 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535931.678509:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdc752 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788535931.678668:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788535931.678734:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdc752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535931.678751:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdc752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535931.678806:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788535931.678943:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535931.678984:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdc752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535931.679010:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fc00/0xe79af2f39bbdc74b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655347 expref: 7 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535931.679031:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdc752 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655347 expref: 6 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535931.679040:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464200) 00010000:00010000:1.0:1788535931.679043:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535931.679046:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e400, rc 0) 00000100:00100000:1.0:1788535931.679113:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:11102:x1875415548328448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 722us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535931.679121:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1788535931.692553:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535931.692639:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548328576 00000100:00100000:0.0:1788535931.692648:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548328576 00000100:00100000:0.0:1788535931.692710:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1788535931.692722:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:11103:x1875415548328576:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535931.692746:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535931.692776:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165534e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.692867:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.692883:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.692893:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.692907:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.692914:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.692921:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.692980:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc76e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.692988:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc76e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.692994:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc76e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535931.693034:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788535931.693038:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535931.693058:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc76e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693079:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693086:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693093:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693098:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535931.693103:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693110:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693122:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464200) 00010000:00010000:0.0:1788535931.693125:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535931.693130:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693136:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693180:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693187:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693193:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693203:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535931.693206:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693213:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693220:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff900583670700) 00010000:00010000:0.0:1788535931.693223:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535931.693225:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693231:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc767 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693261:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165534e expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693274:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc76e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165534e expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535931.693281:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff900583670b00) 00010000:00010000:0.0:1788535931.693283:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535931.693286:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455000, rc 0) 00000100:00100000:0.0:1788535931.693350:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:11103:x1875415548328576:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 630us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535931.693357:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1788535931.707920:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535931.708063:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548328704 00000100:00100000:2.0:1788535931.708073:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548328704 00000100:00100000:2.0:1788535931.708131:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788535931.708141:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:11103:x1875415548328704:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788535931.708257:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:11103:x1875415548328704:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 117us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535931.708264:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788535931.721324:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535931.721401:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548328960 00000100:00100000:3.0:1788535931.721413:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548328960 00000100:00100000:3.0:1788535931.721478:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1788535931.721488:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+7:11103:x1875415548328960:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535931.721512:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535931.721543:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc775 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655355 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.721621:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.721636:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.721647:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.721708:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.721716:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.721723:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.721861:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbdc78a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.721870:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbdc78a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722022:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbdc78a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535931.722037:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788535931.722125:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722133:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722140:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722184:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535931.722190:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722197:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722209:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff900583670b00) 00010000:00010000:3.0:1788535931.722213:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535931.722217:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722233:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc77c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722247:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722253:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722257:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722262:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535931.722265:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722271:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722279:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff900486936900) 00010000:00010000:3.0:1788535931.722282:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535931.722285:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.722291:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc783 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.725315:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc775 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655355 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.725342:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbdc78a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655355 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535931.725364:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:3.0:1788535931.725368:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535931.725371:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50a00, rc 0) 00000100:00100000:3.0:1788535931.725583:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+9:11103:x1875415548328960:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 4093us (4265us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788535931.725593:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1788535931.748521:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535931.748902:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548329088 00000100:00100000:0.0:1788535931.748918:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548329088 00000100:00100000:0.0:1788535931.748980:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1788535931.748991:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:11103:x1875415548329088:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788535931.749118:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:11103:x1875415548329088:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 129us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535931.749126:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1788535931.755473:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535931.755561:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548329216 00000100:00100000:3.0:1788535931.755572:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548329216 00000100:00100000:3.0:1788535931.755649:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788535931.755662:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:11103:x1875415548329216:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788535931.756637:0:10016:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 936us 00000100:00080000:0.0:1788535931.757651:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535931.782209:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:11103:x1875415548329216:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 26539us (26735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.782223:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1788535931.824562:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569393408:0@lo:400:kworker.0 00000100:00100000:2.0:1788535931.824641:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.824792:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569393408 00000100:00100000:3.0:1788535931.824801:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569393408 00000100:00100000:3.0:1788535931.824885:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788535931.824898:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3662:x1875415569393408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.830612:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3662:x1875415569393408:12345-0@lo:400:kworker.0 Request processed in 5711us (5965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.830627:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788535931.830722:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569393792:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.830785:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.830811:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569394304:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.830851:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.830888:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569394816:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.830912:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.830937:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788535931.830942:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569393664:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.830966:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.830983:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569394176:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831002:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.831019:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569394688:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831038:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.831064:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569393792 00000100:00100000:3.0:1788535931.831071:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569393792 00000100:00100000:3.0:1788535931.831108:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569394176 00000100:00100000:3.0:1788535931.831111:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569394176 00000100:00100000:3.0:1788535931.831134:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569394688 00000100:00100000:3.0:1788535931.831137:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569394688 00000100:00100000:3.0:1788535931.831175:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788535931.831183:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569393792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831230:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569393792:12345-0@lo:400:kworker.0 Request processed in 48us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.831236:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788535931.831249:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788535931.831256:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569394176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831279:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569394176:12345-0@lo:400:kworker.0 Request processed in 24us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.831285:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788535931.831295:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788535931.831301:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569394688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831349:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569394688:12345-0@lo:400:kworker.0 Request processed in 49us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.831355:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788535931.831374:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569394304 00000100:00100000:3.0:1788535931.831377:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569394304 00000100:00100000:3.0:1788535931.831401:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569394816 00000100:00100000:3.0:1788535931.831404:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569394816 00000100:00100000:3.0:1788535931.831422:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788535931.831429:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569394304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831456:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569394304:12345-0@lo:400:kworker.0 Request processed in 29us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.831462:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788535931.831472:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788535931.831477:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569394816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831501:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569394816:12345-0@lo:400:kworker.0 Request processed in 24us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.831506:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788535931.831526:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569393664 00000100:00100000:3.0:1788535931.831528:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569393664 00000100:00100000:3.0:1788535931.831552:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788535931.831559:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569393664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831589:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569393664:12345-0@lo:400:kworker.0 Request processed in 31us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.831594:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1788535931.831616:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535931.831619:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535931.831622:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535931.831676:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569393664:0@lo:400:kworker.0 00010000:00080000:3.0:1788535931.831690:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004883d6300 x1875415569394176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535931.831700:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569394176:0@lo:400:kworker.0 00010000:00080000:3.0:1788535931.831709:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004883d7800 x1875415569394688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535931.831717:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569394688:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831727:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569393792:0@lo:400:kworker.0 00010000:00080000:3.0:1788535931.831735:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004883d5880 x1875415569394304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535931.831742:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569394304:0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.831750:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569394816:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.832131:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569393536:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.832187:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535931.832221:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569394048:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.832243:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535931.832257:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569394560:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.832275:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535931.832293:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788535931.832300:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569393920:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.832334:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535931.832348:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569394432:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.832368:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535931.832381:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569394944:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.832399:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535931.832542:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569393536 00000100:00100000:3.0:1788535931.832549:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569393536 00000100:00100000:3.0:1788535931.832584:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569394048 00000100:00100000:3.0:1788535931.832587:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569394048 00000100:00100000:3.0:1788535931.832610:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569394560 00000100:00100000:3.0:1788535931.832613:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569394560 00000100:00100000:3.0:1788535931.832626:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788535931.832633:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569393536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.832687:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569393536:12345-0@lo:400:kworker.0 Request processed in 54us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.832695:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788535931.832707:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788535931.832720:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569394048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.832751:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569394048:12345-0@lo:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.832757:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788535931.832779:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788535931.832786:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569394560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535931.832811:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569394560:12345-0@lo:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535931.832817:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788535931.833239:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569393536:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.833251:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569394048:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.833259:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569394560:0@lo:400:kworker.0 00000100:00100000:2.0:1788535931.835312:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569393408:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.836096:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569394432 00000100:00100000:1.0:1788535931.836105:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569394432 00000100:00100000:1.0:1788535931.836171:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569394944 00000100:00100000:1.0:1788535931.836175:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569394944 00000100:00100000:1.0:1788535931.836202:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788535931.836212:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569394432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.836282:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569394432:12345-0@lo:400:kworker.0 Request processed in 73us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535931.836302:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788535931.836318:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788535931.838207:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569394944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.838288:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569394944:12345-0@lo:400:kworker.0 Request processed in 1963us (5887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535931.838297:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:1.0:1788535931.838429:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004883d5f80 x1875415569394432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788535947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535931.838443:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569394432:0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.838456:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569394944:0@lo:400:kworker.0 00000100:00080000:1.0:1788535931.838483:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535931.838488:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788535931.838491:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535931.838505:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569393920 00000100:00100000:1.0:1788535931.838510:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569393920 00000100:00100000:1.0:1788535931.838558:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788535931.838566:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569393920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535931.838608:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569393920:12345-0@lo:400:kworker.0 Request processed in 42us (6272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535931.838614:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788535931.838638:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569393920:0@lo:400:kworker.0 00000040:00080000:0.0:1788535931.950712:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788535931.951116:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788535932.079482:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535932.332348:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788535932.332372:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569395072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535932.332442:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535932.332543:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569395072 00000100:00100000:0.0:1788535932.332551:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569395072 00000100:00100000:0.0:1788535932.332602:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788535932.332611:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569395072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535932.332638:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535932.332686:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569395072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535932.332692:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788535932.332736:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569395072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535932.334382:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535932.334399:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569395200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788535932.334451:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535932.334562:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569395200 00000100:00100000:0.0:1788535932.334569:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569395200 00000100:00100000:0.0:1788535932.334615:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788535932.334624:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569395200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535932.334642:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535932.334688:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569395200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535932.334694:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788535932.334748:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569395200:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788535933.103668:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535933.359370:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788535933.359391:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569395328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535933.359466:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535933.359536:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569395328 00000100:00100000:3.0:1788535933.359544:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569395328 00000100:00100000:3.0:1788535933.359594:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788535933.359604:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569395328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535933.359642:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535933.359685:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569395328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535933.359691:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:3.0:1788535933.359732:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004883c5180 x1875415569395328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535933.359748:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569395328:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788535933.360043:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535933.364832:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535933.364858:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569395456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535933.364953:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535933.365389:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569395456 00000100:00100000:2.0:1788535933.365398:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569395456 00000100:00100000:2.0:1788535933.365470:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788535933.365480:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569395456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788535933.365501:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535933.365550:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569395456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535933.365556:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1788535933.365597:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004883c5180 x1875415569395456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788535949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535933.365626:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569395456:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788535933.365794:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535933.827577:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535933.827965:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548329344 00000100:00100000:0.0:1788535933.827974:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548329344 00000100:00100000:0.0:1788535933.828040:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1788535933.828050:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+9:11145:x1875415548329344:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535933.828069:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535933.828088:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165535c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828176:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828193:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828207:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828221:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828227:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828234:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828273:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828280:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828299:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828305:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535933.828309:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828317:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828328:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464200) 00010000:00010000:0.0:1788535933.828331:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535933.828336:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828342:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc79f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828354:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828360:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828366:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828371:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535933.828374:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828391:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828475:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9005b7af4700) 00010000:00010000:0.0:1788535933.828479:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535933.828483:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828489:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc7a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828524:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc798 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165535c expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828534:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464200) 00010000:00010000:0.0:1788535933.828536:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535933.828540:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165535c expref: 10 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535933.828551:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454a00, rc 0) 00000100:00100000:0.0:1788535933.828611:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+9:11145:x1875415548329344:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 561us (1042us total) trans 0 rc 301/301 00000100:00100000:0.0:1788535933.828618:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00080000:1.0:1788535933.829087:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535933.835087:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535933.835279:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548329600 00000100:00100000:3.0:1788535933.835290:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548329600 00000100:00100000:3.0:1788535933.835351:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:3.0:1788535933.835360:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:11145:x1875415548329600:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:3.0:1788535933.835412:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535933.835439:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdc752 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655347 expref: 9 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.835456:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464200) 00010000:00010000:3.0:1788535933.835467:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535933.835529:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.835542:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.835552:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.835563:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.835570:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.835576:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836385:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836406:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836415:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535933.836432:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000032f22bd reply state 0000000094beb28e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836444:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836450:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:3.0:1788535933.836453:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535933.836457:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788535933.836462:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788535933.836469:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836475:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836481:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836487:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535933.836491:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836500:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836519:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:3.0:1788535933.836522:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535933.836526:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836533:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535933.836550:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000032f22bd reply state 0000000094beb28e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836559:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.836565:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff900486936d00) 00010000:00010000:3.0:1788535933.836567:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535933.836569:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788535933.836665:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+10:11145:x1875415548329600:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 1304us (1585us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788535933.836673:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1788535933.868372:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569395584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788535933.868445:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535933.870439:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569395584 00000100:00100000:1.0:1788535933.870467:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569395584 00000100:00100000:1.0:1788535933.870530:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788535933.870540:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569395584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788535933.870573:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788535933.870639:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569395584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535933.870645:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788535933.870764:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569395584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535933.959376:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535933.959454:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548329728 00000100:00100000:3.0:1788535933.959464:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548329728 00000100:00100000:3.0:1788535933.959555:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1788535933.959565:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+10:11153:x1875415548329728:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:3.0:1788535933.959587:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535933.959610:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655363 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.959668:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbdc7c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.959696:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbdc7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.959706:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbdc7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535933.959760:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788535933.959765:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788535933.959803:0:6533:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbdc7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.959827:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655363 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.959846:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbdc7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655363 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535933.959854:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:3.0:1788535933.959857:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535933.959860:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51c00, rc 0) 00000100:00100000:3.0:1788535933.959926:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+11:11153:x1875415548329728:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 362us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535933.959933:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1788535934.005722:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.005827:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548329856 00000100:00100000:1.0:1788535934.005838:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548329856 00000100:00100000:1.0:1788535934.005899:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1788535934.005911:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+11:11159:x1875415548329856:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535934.005932:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535934.005952:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdc7d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165536a expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006017:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006032:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006044:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006055:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006062:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006086:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006222:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fc00/0xe79af2f39bbdc7e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006231:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fc00/0xe79af2f39bbdc7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006238:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fc00/0xe79af2f39bbdc7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535934.006272:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788535934.006276:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535934.006313:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fc00/0xe79af2f39bbdc7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006326:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006333:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006344:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006349:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535934.006354:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006362:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006381:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:1.0:1788535934.006384:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535934.006389:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006396:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc7d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006410:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006417:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006423:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006429:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535934.006432:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006438:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006456:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff900486936d00) 00010000:00010000:1.0:1788535934.006459:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535934.006462:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006469:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdc7de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006506:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdc7d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165536a expref: 13 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006518:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fc00/0xe79af2f39bbdc7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165536a expref: 12 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.006525:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:1.0:1788535934.006527:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788535934.006530:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fc00, rc 0) 00000100:00100000:1.0:1788535934.006596:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+12:11159:x1875415548329856:12345-192.168.203.13@tcp:101:bash.0 Request processed in 687us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.006603:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1788535934.011134:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.012083:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548330112 00000100:00100000:3.0:1788535934.012094:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548330112 00000100:00100000:3.0:1788535934.012251:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1788535934.012263:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e70fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+12:11159:x1875415548330112:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788535934.012286:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535934.012320:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655371 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.012413:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.012427:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.012438:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.012503:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.012512:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.012519:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535934.012846:0:6534:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788535934.013007:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013018:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013025:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013058:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013075:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013082:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013088:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535934.013093:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013102:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013114:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:3.0:1788535934.013117:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535934.013122:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013128:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc7f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535934.013141:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000c56b4590 reply state 000000004ec19e76 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013187:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013193:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936000) 00010000:00010000:3.0:1788535934.013196:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535934.013198:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788535934.013228:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc7ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655371 expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013251:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655371 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.013261:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff900486936e00) 00010000:00010000:3.0:1788535934.013263:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535934.013265:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3e200, rc 0) 00000100:00100000:3.0:1788535934.013329:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e70fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+15:11159:x1875415548330112:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1068us (2206us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788535934.013336:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1788535934.017959:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.018059:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548330240 00000100:00100000:3.0:1788535934.018069:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548330240 00000100:00100000:3.0:1788535934.018194:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1788535934.018203:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1875415548330240:12345-192.168.203.13@tcp:8:bash.0 00010000:00080000:3.0:1788535934.018239:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:3.0:1788535934.018271:0:8446:0:(genops.c:1385:class_connect()) connect: client b9ef506c-5095-4495-a34a-e3b5845d008a, cookie 0xe79af2f39bbdc80f 00002000:00100000:3.0:1788535934.018283:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b9ef506c-5095-4495-a34a-e3b5845d008a/ffff90059fca2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788535934.018296:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788535934.018382:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788535934.018411:0:8446:0:(import.c:65:import_set_state_nolock()) ffff90059fca4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788535934.018493:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2398:x1875415548330240:12345-192.168.203.13@tcp:8:bash.0 Request processed in 289us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535934.018501:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788535934.020840:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.020997:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548330368 00000100:00100000:1.0:1788535934.021006:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548330368 00000100:00100000:1.0:1788535934.021074:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1788535934.021084:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:0:x1875415548330368:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535934.021098:0:10017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788535934.021355:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788535934.021419:0:10017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655378 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788535934.021521:0:10017:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788535934.021543:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1788535934.021548:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535934.021558:0:10017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655378 expref: 7 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.021601:0:10017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655378 expref: 7 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.021615:0:10017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fe00, rc 0) 00000100:00100000:1.0:1788535934.021674:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+7:0:x1875415548330368:12345-192.168.203.13@tcp:101:bash.0 Request processed in 592us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.021682:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1788535934.026577:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535934.026669:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548330496 00000100:00100000:0.0:1788535934.026678:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548330496 00000100:00100000:0.0:1788535934.026735:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:0.0:1788535934.026771:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:11159:x1875415548330496:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788535934.026791:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535934.026813:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165537f expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.026842:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655378 expref: 8 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.026852:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535934.026856:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535934.026862:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.026896:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655378 expref: 8 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.026911:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655378 expref: 8 pid: 10017 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535934.026924:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1875415569395712:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535934.027022:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1a5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788535934.038574:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1875415569395712:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535934.038611:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.038652:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455e00, rc 0) 00000100:00100000:0.0:1788535934.038713:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:11159:x1875415548330496:12345-192.168.203.13@tcp:101:bash.0 Request processed in 11943us (12145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535934.038721:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1788535934.048109:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.048854:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548330624 00000100:00100000:1.0:1788535934.049077:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548330624 00010000:00010000:1.0:1788535934.049143:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655378 expref: 8 pid: 10017 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535934.049414:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1788535934.049425:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfa9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548330624:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535934.049440:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535934.049853:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655378 expref: 8 pid: 10017 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.049935:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655378 expref: 8 pid: 10017 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.049959:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdc816 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655378 expref: 8 pid: 10017 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.049995:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535934.049999:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535934.050008:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.050018:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.050055:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535934.050071:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488822a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6521:1875415569395840:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788535934.050924:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef000 going to sleep for 11 seconds 00000100:00100000:1.0:1788535934.056690:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488822a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6521:1875415569395840:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788535934.056716:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535934.056783:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfa9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2401:x1875415548330624:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 7360us (8691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.056803:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1788535934.059103:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535934.059366:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548330880 00000100:00100000:0.0:1788535934.059375:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548330880 00000100:00100000:0.0:1788535934.059474:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788535934.059485:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+15:11159:x1875415548330880:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1788535934.059804:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11159:x1875415548330880:12345-192.168.203.13@tcp:35:bash.0 Request processed in 321us (709us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788535934.059812:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00010000:00010000:0.0:1788535934.125956:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535934.132455:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.132602:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548331136 00000100:00100000:3.0:1788535934.132626:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548331136 00000100:00100000:3.0:1788535934.132693:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:3.0:1788535934.132703:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11169:x1875415548331136:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535934.132726:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535934.132759:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc824 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655386 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535934.133120:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788535934.133276:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc824 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655386 expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.133291:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:3.0:1788535934.133293:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535934.133299:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc824 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655386 expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.133313:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51200, rc 0) 00000100:00100000:3.0:1788535934.133373:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+17:11169:x1875415548331136:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 671us (926us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788535934.133381:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788535934.140098:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.140181:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548331392 00000100:00100000:3.0:1788535934.140195:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548331392 00000100:00100000:3.0:1788535934.140251:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1788535934.140261:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+17:11169:x1875415548331392:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788535934.140481:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+18:11169:x1875415548331392:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 221us (393us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788535934.140488:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788535934.222575:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535934.222669:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548331520 00000100:00100000:0.0:1788535934.222680:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548331520 00000100:00100000:0.0:1788535934.222744:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1788535934.222764:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+18:11175:x1875415548331520:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535934.222787:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535934.222806:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165538d expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.222887:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc839 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.222903:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.222935:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535934.222981:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788535934.222984:0:10016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535934.223007:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.223034:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165538d expref: 20 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.223053:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165538d expref: 19 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.223061:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535934.223064:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535934.223068:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454a00, rc 0) 00000100:00100000:0.0:1788535934.223132:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11175:x1875415548331520:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 380us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535934.223140:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1788535934.230633:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535934.230738:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548331776 00000100:00100000:0.0:1788535934.230758:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548331776 00000100:00100000:0.0:1788535934.231016:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1788535934.231028:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11175:x1875415548331776:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535934.231047:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535934.231065:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdc840 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655394 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.231499:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc847 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.231516:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.231528:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc847 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535934.231538:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788535934.231640:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdc840 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655394 expref: 22 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.231659:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc847 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655394 expref: 21 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.231669:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff900486936e00) 00010000:00010000:0.0:1788535934.231673:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535934.231676:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455200, rc 0) 00000100:00100000:0.0:1788535934.231728:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+21:11175:x1875415548331776:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 702us (1104us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788535934.231735:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1788535934.240387:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535934.240429:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.240600:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548332160 00000100:00100000:1.0:1788535934.240609:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548332160 00000100:00100000:1.0:1788535934.240673:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1788535934.240684:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+21:2400:x1875415548332160:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535934.240699:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535934.240725:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc847 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655394 expref: 21 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.240768:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff900486936e00) 00010000:00010000:1.0:1788535934.240774:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535934.240829:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+20:2400:x1875415548332160:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 147us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.240837:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1788535934.241299:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548332032 00000100:00100000:3.0:1788535934.241304:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548332032 00000100:00100000:3.0:1788535934.241344:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1788535934.241352:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+20:11175:x1875415548332032:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535934.241371:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535934.241386:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc855 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165539b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.241487:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc85c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.241500:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc85c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.241511:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc85c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535934.241522:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788535934.241611:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc855 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165539b expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.241626:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc85c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165539b expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.241634:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff900486936e00) 00010000:00010000:3.0:1788535934.241636:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788535934.241638:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50400, rc 0) 00000100:00100000:3.0:1788535934.241681:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11175:x1875415548332032:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 330us (1304us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788535934.241698:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1788535934.251399:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.251541:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548332288 00000100:00100000:1.0:1788535934.251550:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548332288 00000100:00100000:1.0:1788535934.251606:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1788535934.251616:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548332288:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:1.0:1788535934.251658:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.251678:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.251687:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788535934.251691:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535934.251696:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.251731:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.251746:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 7 pid: 8448 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535934.251791:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1875415569395968:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535934.251899:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef840 going to sleep for 11 seconds 00000100:00100000:1.0:1788535934.255223:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535934.255916:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488822a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1875415569395968:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535934.255943:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535934.257330:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548332416 00000100:00100000:3.0:1788535934.257345:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548332416 00002000:00100000:3.0:1788535934.257392:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff900488822680 x1875415548332416/t0(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:590/0 lens 504/0 e 0 to 0 dl 1788535945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535934.257403:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff900488822680 with x1875415548332416 ext(0->12) 00010000:00010000:3.0:1788535934.257411:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 8 pid: 8448 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.257427:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 8 pid: 8448 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535934.257436:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff900488822680 00000100:00100000:3.0:1788535934.257524:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788535934.257534:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548332416:12345-192.168.203.13@tcp:4:lfs.0 00000001:00100000:2.0:1788535934.261271:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000100:00100000:3.0:1788535934.262122:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2401:x1875415548332416:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 4583us (6901us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788535934.262134:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:3.0:1788535934.265303:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff900488822680 x1875415548332416/t4294967300(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:590/0 lens 504/448 e 0 to 0 dl 1788535945 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535934.265320:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff900488822680 with x1875415548332416 ext(0->12) 00010000:00010000:3.0:1788535934.265332:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 9 pid: 8448 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.265366:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 9 pid: 8448 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535934.265376:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff900488822680 00000100:00100000:1.0:1788535934.265668:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535934.265740:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548332544 00000100:00100000:2.0:1788535934.265758:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548332544 00010000:00010000:2.0:1788535934.265793:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 9 pid: 8448 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535934.266017:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1788535934.266028:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2399:x1875415548332544:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535934.266044:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788535934.266063:0:10351:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788535934.266066:0:10351:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788535934 00002000:00010000:2.0:1788535934.266069:0:10351:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788535934 00002000:00010000:2.0:1788535934.266078:0:10351:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788535934 00002000:00010000:2.0:1788535934.266081:0:10351:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788535934.266087:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 9 pid: 8448 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.266101:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 9 pid: 8448 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.266127:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069038501/0xe79af2f39bbdc81d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165537f expref: 9 pid: 8448 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.266192:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788535934.266196:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788535934.266202:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.266211:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.266245:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535934.266294:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488821500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2399:x1875415548332544:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 268us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535934.266302:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00010000:00010000:0.0:1788535934.266734:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.266746:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.266792:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.266801:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.266810:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.266823:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788535934.266828:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.266839:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.266854:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.266878:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e8b619d/0xe79af2f39bbdc86a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535934.266938:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548332288:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 15323us (15548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535934.266947:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1788535934.270273:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.270418:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548332800 00000100:00100000:3.0:1788535934.270427:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548332800 00000100:00100000:3.0:1788535934.270481:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1788535934.270491:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11175:x1875415548332800:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:3.0:1788535934.270559:0:6536:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc85c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165539b expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535934.270771:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788535934.270829:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788535934.271126:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788535934.272109:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.272128:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655371 expref: 26 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.272138:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.272355:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655371 expref: 26 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.272373:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655371 expref: 26 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535934.272400:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6536:1875415569396096:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535934.272739:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac8630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535934.277394:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.277841:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548332928 00000100:00100000:1.0:1788535934.277851:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548332928 00010000:00010000:1.0:1788535934.277904:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655371 expref: 27 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535934.277946:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1788535934.277956:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+27:2402:x1875415548332928:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535934.277970:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535934.277977:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655371 expref: 27 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.277990:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655371 expref: 27 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.278014:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff900486936e00) 00010000:00010000:1.0:1788535934.278019:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.278029:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.278036:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.278071:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535934.278362:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+27:2402:x1875415548332928:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 406us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.278371:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00010000:00010000:3.0:1788535934.278711:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc801 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655371 expref: 26 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535934.278729:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6536:1875415569396096:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535934.278763:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.278772:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.278778:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535934.279020:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788535934.279133:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788535934.279314:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1875415569396224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788535934.279367:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535934.279393:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac863000 going to sleep for 11 seconds 00000100:00100000:1.0:1788535934.279525:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569396224 00000100:00100000:1.0:1788535934.279531:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569396224 00000100:00100000:1.0:1788535934.279575:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788535934.279584:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6536:x1875415569396224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788535934.279669:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6536:x1875415569396224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.279676:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788535934.279767:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1875415569396224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788535934.279928:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788535934.279971:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1875415569396352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788535934.280010:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535934.280032:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048818a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788535934.281299:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569396352 00000100:00100000:1.0:1788535934.281310:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569396352 00000100:00100000:1.0:1788535934.281348:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788535934.281357:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6536:x1875415569396352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788535934.281641:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6536:x1875415569396352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 284us (1629us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788535934.281648:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788535934.282003:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1875415569396352:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788535934.282070:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788535934.282114:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.282125:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.282133:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.282139:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535934.282143:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.282943:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.282966:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff900486936e00) 00010000:00010000:2.0:1788535934.282969:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788535934.282974:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.282981:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc871 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788535934.283098:0:6536:0:(mdd_object.c:4338:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788535934.283276:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788535934.283290:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393087142689ns, next at 394087140304ns, rc = 0 00000001:00080000:2.0:1788535934.283311:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788535934.283345:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff900486936e00) 00010000:00010000:2.0:1788535934.283348:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788535934.283355:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc85c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165539b expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535934.283463:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+29:11175:x1875415548332800:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 12972us (13199us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788535934.283472:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000020:00080000:2.0:1788535934.283476:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788535934.286475:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.286608:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548333056 00000100:00100000:1.0:1788535934.286618:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548333056 00000100:00100000:1.0:1788535934.286683:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1788535934.286693:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+29:11175:x1875415548333056:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535934.286716:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535934.286738:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc878 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553a2 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.286831:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc878 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553a2 expref: 30 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.286847:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc878 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553a2 expref: 30 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.286875:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535934.286878:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788535934.286882:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e000, rc 0) 00000100:00100000:1.0:1788535934.286940:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+30:11175:x1875415548333056:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 248us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.286947:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1788535934.290529:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535934.290690:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548333312 00000100:00100000:2.0:1788535934.290700:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548333312 00000100:00100000:2.0:1788535934.290767:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1788535934.290777:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf16050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+30:11175:x1875415548333312:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788535934.291003:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf16050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+31:11175:x1875415548333312:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 226us (482us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788535934.291012:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1788535934.382573:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788535934.382595:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569396480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535934.382663:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535934.382805:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569396480 00000100:00100000:1.0:1788535934.382822:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569396480 00000100:00100000:1.0:1788535934.382872:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788535934.382881:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569396480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788535934.382914:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1788535934.382966:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569396480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.382973:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788535934.383215:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569396480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788535934.391533:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.391821:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548333568 00000100:00100000:3.0:1788535934.391831:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548333568 00000100:00100000:3.0:1788535934.391902:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1788535934.391913:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+31:11185:x1875415548333568:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535934.391935:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535934.391955:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc87f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553a9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535934.392276:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788535934.392374:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc87f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553a9 expref: 33 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.392389:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:3.0:1788535934.392392:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535934.392397:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc87f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553a9 expref: 33 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.392412:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030c00, rc 0) 00000100:00100000:3.0:1788535934.392530:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+32:11185:x1875415548333568:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 618us (1014us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788535934.392538:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1788535934.397359:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.397438:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548333696 00000100:00100000:3.0:1788535934.397458:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548333696 00000100:00100000:3.0:1788535934.397512:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1788535934.397524:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+32:11185:x1875415548333696:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1788535934.397605:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397621:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397632:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397645:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397666:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397673:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397743:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397765:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397772:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535934.397816:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397827:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397833:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397839:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397845:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535934.397848:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397856:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397894:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:3.0:1788535934.397897:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535934.397902:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397908:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc88d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397923:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397929:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397935:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397940:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535934.397943:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397949:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397956:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936000) 00010000:00010000:3.0:1788535934.397958:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535934.397961:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397967:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc894 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397987:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397994:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.397999:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.398004:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535934.398007:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.398014:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.398021:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:3.0:1788535934.398024:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535934.398026:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.398032:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc89b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535934.398678:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+32:11185:x1875415548333696:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1153us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535934.398688:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:0.0:1788535934.403027:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535934.404055:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548333952 00000100:00100000:2.0:1788535934.404133:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548333952 00000100:00100000:2.0:1788535934.404347:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1788535934.404358:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+32:11185:x1875415548333952:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788535934.404608:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+33:11185:x1875415548333952:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 251us (1588us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788535934.404629:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1788535934.450801:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.450903:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548334208 00000100:00100000:3.0:1788535934.450913:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548334208 00000100:00100000:3.0:1788535934.450971:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1788535934.450996:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+33:11188:x1875415548334208:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535934.451019:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535934.451040:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc8a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553b0 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451124:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451141:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451501:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451517:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451525:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451532:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451629:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451639:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451647:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535934.451669:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788535934.451744:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451764:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451771:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451777:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535934.451781:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451788:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451800:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:3.0:1788535934.451803:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535934.451807:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451813:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdc8a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451827:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451833:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451849:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451854:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535934.451951:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451960:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451968:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936000) 00010000:00010000:3.0:1788535934.451970:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535934.451973:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.451979:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdc8b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.452018:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdc8a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b0 expref: 36 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.452032:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b0 expref: 35 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.452039:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:3.0:1788535934.452041:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535934.452044:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030e00, rc 0) 00000100:00100000:3.0:1788535934.453393:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+35:11188:x1875415548334208:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2391us (2592us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788535934.453418:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1788535934.457004:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.457441:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548334336 00000100:00100000:1.0:1788535934.457463:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548334336 00000100:00100000:1.0:1788535934.457514:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1788535934.457525:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+35:11188:x1875415548334336:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1788535934.457589:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.457618:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.457631:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.457672:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.457679:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.457685:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.457690:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535934.457694:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.457701:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.457711:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535934.457715:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535934.457719:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.457724:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535934.457856:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+35:11188:x1875415548334336:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 332us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.457881:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1788535934.461733:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.461923:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548334592 00000100:00100000:3.0:1788535934.461931:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548334592 00000100:00100000:3.0:1788535934.461987:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788535934.461998:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+35:11188:x1875415548334592:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788535934.462743:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+36:11188:x1875415548334592:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 743us (1015us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788535934.462763:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788535934.769030:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.769277:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548334848 00000100:00100000:1.0:1788535934.769288:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548334848 00000100:00100000:1.0:1788535934.769352:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1788535934.769363:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+36:11219:x1875415548334848:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1788535934.769385:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535934.769402:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553b7 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.769486:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc8d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.769497:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.769506:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535934.769513:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788535934.769608:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b7 expref: 39 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.769637:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b7 expref: 38 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.769645:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535934.769648:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535934.769665:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e600, rc 0) 00000100:00100000:1.0:1788535934.769903:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+38:11219:x1875415548334848:12345-192.168.203.13@tcp:101:cat.0 Request processed in 541us (881us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788535934.769911:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1788535934.779019:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.779493:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548334976 00000100:00100000:1.0:1788535934.779504:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548334976 00000100:00100000:1.0:1788535934.780025:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1788535934.780037:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+38:2399:x1875415548334976:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535934.780055:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535934.780078:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc8d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b7 expref: 38 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.780096:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535934.780100:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535934.781548:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+37:2399:x1875415548334976:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 848us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.781561:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1788535934.787665:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.792432:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548335232 00000100:00100000:1.0:1788535934.792446:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548335232 00000100:00100000:1.0:1788535934.792575:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1788535934.792587:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+37:11219:x1875415548335232:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:1.0:1788535934.792850:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+38:11219:x1875415548335232:12345-192.168.203.13@tcp:35:cat.0 Request processed in 264us (5193us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788535934.792857:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788535934.847415:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.847464:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.847493:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.847536:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535934.847604:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548335360 00000100:00100000:2.0:1788535934.847623:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548335360 00000100:00100000:2.0:1788535934.847674:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 375 00000100:00100000:2.0:1788535934.847683:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2400:x1875415548335360:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535934.847757:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2400:x1875415548335360:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 63us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535934.847764:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 375 00000100:00100000:3.0:1788535934.848042:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548335616 00000100:00100000:3.0:1788535934.848048:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548335616 00000100:00100000:3.0:1788535934.848093:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548335488 00000100:00100000:3.0:1788535934.848097:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548335488 00000100:00100000:3.0:1788535934.848116:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548335744 00000100:00100000:3.0:1788535934.848119:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548335744 00000100:00100000:3.0:1788535934.848136:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 258 00000100:00100000:3.0:1788535934.848143:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548335616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535934.848353:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 259 00000100:00100000:0.0:1788535934.848363:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548335488:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535934.848405:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548335488:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535934.848412:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 259 00000100:00100000:0.0:1788535934.848428:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 260 00000100:00100000:0.0:1788535934.848435:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548335744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535934.848459:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548335744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535934.848465:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 260 00000100:00080000:2.0:1788535934.849314:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535934.849321:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535934.849800:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548335616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 1653us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535934.849810:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 258 00000100:00100000:0.0:1788535934.855279:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.856116:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548336000 00000100:00100000:1.0:1788535934.856128:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548336000 00000100:00100000:1.0:1788535934.856221:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1788535934.856241:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+38:11225:x1875415548336000:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:1.0:1788535934.856268:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535934.856272:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788535934.856298:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165538d expref: 38 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.856318:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:1.0:1788535934.856323:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535934.856336:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc8e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553be expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.856433:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.856445:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b0 expref: 38 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.856453:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.856482:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b0 expref: 38 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.856496:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b0 expref: 38 pid: 10112 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535934.856508:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488823480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875415569396608:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535934.856613:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535934.867054:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.869108:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488823480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875415569396608:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535934.869139:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535934.872232:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548336128 00000100:00100000:3.0:1788535934.872250:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548336128 00010000:00010000:2.0:1788535934.872446:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b0 expref: 39 pid: 10112 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535934.872494:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:2.0:1788535934.872504:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+39:2402:x1875415548336128:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535934.872524:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535934.872531:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b0 expref: 39 pid: 10112 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.872567:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b0 expref: 39 pid: 10112 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.872590:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdc8b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553b0 expref: 39 pid: 10112 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.872609:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:2.0:1788535934.872614:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.872623:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.872630:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535934.872905:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535934.872971:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+38:2402:x1875415548336128:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 468us (5927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535934.872980:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00010000:00010000:0.0:1788535934.874338:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.874352:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535934.874372:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788535934.874629:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc8e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553be expref: 39 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.874664:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553be expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535934.874673:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:0.0:1788535934.874676:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788535934.874679:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e200, rc 0) 00000100:00100000:0.0:1788535934.874970:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+38:11225:x1875415548336000:12345-192.168.203.13@tcp:101:dd.0 Request processed in 18730us (19699us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788535934.874978:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788535934.882636:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535934.882742:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548336256 00000100:00100000:1.0:1788535934.882762:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548336256 00000100:00100000:1.0:1788535934.883142:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1788535934.883190:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+38:11225:x1875415548336256:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:1.0:1788535934.883214:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535934.883235:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdc8f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553c5 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.883266:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.883281:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.883298:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.883436:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdc8f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553c5 expref: 40 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.883455:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553c5 expref: 39 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535934.883465:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535934.883468:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788535934.883478:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f600, rc 0) 00000100:00100000:1.0:1788535934.883527:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+39:11225:x1875415548336256:12345-192.168.203.13@tcp:101:dd.0 Request processed in 340us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535934.883600:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788535934.890344:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535934.890519:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548336512 00000100:00100000:3.0:1788535934.890528:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548336512 00000100:00100000:3.0:1788535934.890614:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:3.0:1788535934.890640:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+39:11225:x1875415548336512:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:3.0:1788535934.890889:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.890916:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.890928:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535934.890972:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788535934.890993:0:6535:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000a76ba0b9 reply state 00000000b7de920c transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.891018:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535934.891026:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:3.0:1788535934.891028:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535934.891032:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535934.891123:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+42:11225:x1875415548336512:12345-192.168.203.13@tcp:36:dd.0 Request processed in 485us (788us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788535934.891131:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000020:00080000:3.0:1788535934.891136:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788535935.148380:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535935.165829:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535935.165991:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548336640 00000100:00100000:1.0:1788535935.166000:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548336640 00000100:00100000:1.0:1788535935.166093:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1788535935.166104:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+42:11239:x1875415548336640:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:1.0:1788535935.166127:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788535935.166180:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788535935.166183:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdc90b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553cc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166256:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166270:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166282:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166294:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166301:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166307:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166382:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166406:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553be expref: 43 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166414:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166469:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553be expref: 43 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.166494:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553be expref: 43 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535935.166508:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488823480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875415569396736:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535935.168258:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef180 going to sleep for 11 seconds 00000100:00100000:1.0:1788535935.180343:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488823480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875415569396736:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535935.180377:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535935.184242:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535935.184398:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548336896 00000100:00100000:2.0:1788535935.184408:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548336896 00000100:00100000:2.0:1788535935.184476:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788535935.184495:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+44:6169:x1875415548336896:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788535935.185118:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+45:6169:x1875415548336896:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 516us (777us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788535935.185144:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788535935.195004:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535935.197205:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548337024 00000100:00100000:1.0:1788535935.197222:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548337024 00010000:00010000:1.0:1788535935.197276:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553be expref: 45 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535935.197326:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1788535935.197337:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+45:2402:x1875415548337024:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535935.197353:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535935.197376:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553be expref: 45 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.197391:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553be expref: 45 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.197415:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc8e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553be expref: 45 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.197431:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535935.197436:0:10351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.197447:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.197463:0:10351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.197506:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535935.197546:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197554:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535935.197571:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+44:2402:x1875415548337024:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 236us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535935.197578:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000004:00200000:0.0:1788535935.197605:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788535935.197609:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535935.197649:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197662:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197672:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197685:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197691:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197696:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620ee00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.197701:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197709:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197719:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535935.197721:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535935.197725:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197730:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdc912 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197741:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197755:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197761:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197766:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.197775:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197781:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197790:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936000) 00010000:00010000:0.0:1788535935.197793:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535935.197796:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197802:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdc919 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197833:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdc90b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553cc expref: 44 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197848:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553cc expref: 43 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.197855:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:0.0:1788535935.197858:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535935.197860:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e600, rc 0) 00000100:00100000:0.0:1788535935.197886:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+43:11239:x1875415548336640:12345-192.168.203.13@tcp:101:stat.0 Request processed in 31785us (32070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535935.197893:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1788535935.314076:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535935.314264:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548337280 00000100:00100000:1.0:1788535935.314274:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548337280 00000100:00100000:1.0:1788535935.314333:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788535935.314343:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+43:11245:x1875415548337280:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:1.0:1788535935.314401:0:10016:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535935.314427:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc920 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553cc expref: 43 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.314461:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535935.314465:0:10016:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535935.314628:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.314642:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.314650:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535935.314690:0:10016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1788535935.314710:0:10016:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000b04744b2 reply state 000000003c3b8e48 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.314723:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.314728:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535935.314731:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788535935.314733:0:10016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535935.314853:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+45:11245:x1875415548337280:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 511us (786us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788535935.314923:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000020:00080000:1.0:1788535935.314928:0:10016:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788535935.480697:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535935.486347:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548337408 00000100:00100000:0.0:1788535935.486363:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548337408 00000100:00100000:0.0:1788535935.486444:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1788535935.486472:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+45:11260:x1875415548337408:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:0.0:1788535935.486500:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535935.486521:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc92e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553d3 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486589:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486605:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486617:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486629:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486637:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486644:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486728:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486737:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486757:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535935.486808:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788535935.486813:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535935.486836:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486848:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486856:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486863:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486870:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486876:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.486880:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486888:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486901:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535935.486904:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535935.486908:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486914:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc935 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486951:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486965:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486971:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486976:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.486979:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486986:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.486995:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936000) 00010000:00010000:0.0:1788535935.486997:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535935.487000:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.487006:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc93c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.487033:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc92e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553d3 expref: 47 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.487048:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553d3 expref: 46 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.487066:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:0.0:1788535935.487068:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535935.487071:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455a00, rc 0) 00000100:00100000:0.0:1788535935.487189:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+46:11260:x1875415548337408:12345-192.168.203.13@tcp:101:stat.0 Request processed in 676us (6457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535935.487197:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:2.0:1788535935.594530:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535935.594622:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548337664 00000100:00100000:0.0:1788535935.594633:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548337664 00000100:00100000:0.0:1788535935.594692:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1788535935.594702:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+46:11270:x1875415548337664:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535935.594721:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535935.594752:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc94a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553da expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535935.594848:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788535935.594947:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc94a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553da expref: 48 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.594961:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:0.0:1788535935.594964:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535935.594969:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc94a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553da expref: 48 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.594983:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455e00, rc 0) 00000100:00100000:0.0:1788535935.595051:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+47:11270:x1875415548337664:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 351us (531us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788535935.595071:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:2.0:1788535935.599415:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535935.599563:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548337920 00000100:00100000:0.0:1788535935.599573:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548337920 00000100:00100000:0.0:1788535935.599631:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:0.0:1788535935.599641:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+47:11270:x1875415548337920:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788535935.599903:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+48:11270:x1875415548337920:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 263us (498us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788535935.599911:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788535935.697615:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535935.697722:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548338176 00000100:00100000:0.0:1788535935.697732:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548338176 00000100:00100000:0.0:1788535935.697814:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:0.0:1788535935.697826:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+48:11276:x1875415548338176:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788535935.697849:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535935.697885:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc958 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553e1 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.697988:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.698003:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553d3 expref: 49 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.698012:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.698046:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553d3 expref: 49 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.698080:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553d3 expref: 49 pid: 6535 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535935.698094:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569396864:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535935.698239:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1a59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535935.706708:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535935.707072:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548338304 00000100:00100000:1.0:1788535935.707081:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548338304 00010000:00010000:1.0:1788535935.707135:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553d3 expref: 50 pid: 6535 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535935.707225:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1788535935.707237:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+50:2401:x1875415548338304:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535935.707253:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535935.707261:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553d3 expref: 50 pid: 6535 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.707274:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553d3 expref: 50 pid: 6535 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.707307:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535935.707313:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.707324:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.707332:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.707352:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535935.707411:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfabc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+50:2401:x1875415548338304:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 175us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535935.707419:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00010000:00010000:0.0:1788535935.714822:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc943 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553d3 expref: 49 pid: 6535 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535935.714850:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569396864:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535935.714875:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.715001:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.715010:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535935.715031:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788535935.717078:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdc958 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e1 expref: 50 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.717107:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e1 expref: 49 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.717117:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:2.0:1788535935.717120:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788535935.717123:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454a00, rc 0) 00000100:00100000:2.0:1788535935.717423:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+49:11276:x1875415548338176:12345-192.168.203.13@tcp:101:bash.0 Request processed in 19597us (19815us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788535935.717431:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1788535935.737805:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535935.737917:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548338560 00000100:00100000:2.0:1788535935.737926:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548338560 00000100:00100000:2.0:1788535935.737987:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:2.0:1788535935.737998:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+49:11276:x1875415548338560:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:2.0:1788535935.738265:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.738282:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.738294:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535935.738334:0:10112:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788535935.738355:0:10112:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000c7685474 reply state 0000000089441cbb transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.738368:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.738376:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:2.0:1788535935.738378:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788535935.738382:0:10112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788535935.738466:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+52:11276:x1875415548338560:12345-192.168.203.13@tcp:36:bash.0 Request processed in 469us (669us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788535935.738473:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000020:00080000:2.0:1788535935.738478:0:10112:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788535935.747820:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535935.747907:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548338688 00000100:00100000:1.0:1788535935.747926:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548338688 00000100:00100000:1.0:1788535935.747985:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1788535935.747996:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+52:11276:x1875415548338688:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535935.748032:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535935.748053:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc974 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553e8 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.748139:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.748175:0:10016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e1 expref: 53 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.748184:0:10016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.748219:0:10016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e1 expref: 53 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.748232:0:10016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e1 expref: 53 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535935.748245:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488821500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569396992:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535935.750404:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef600 going to sleep for 11 seconds 00000100:00100000:1.0:1788535935.755353:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488821500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569396992:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535935.755385:0:10016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535935.758803:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535935.759189:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548338816 00000100:00100000:1.0:1788535935.759199:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548338816 00010000:00010000:1.0:1788535935.759245:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e1 expref: 54 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535935.760038:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1788535935.760053:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+54:2402:x1875415548338816:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535935.760068:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535935.760075:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e1 expref: 54 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.760090:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e1 expref: 54 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.760113:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc95f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e1 expref: 54 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.760130:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535935.760135:0:10351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.760193:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.760201:0:10351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535935.760234:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535935.760278:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+53:2402:x1875415548338816:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 230us (1485us total) trans 0 rc 0/0 00010000:00010000:0.0:1788535935.760333:0:10016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.760342:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535935.760405:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788535935.760410:0:10016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535935.760430:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.760458:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdc974 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e8 expref: 54 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.760472:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e8 expref: 53 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.760493:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:0.0:1788535935.760495:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535935.760498:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fa00, rc 0) 00000100:00100000:0.0:1788535935.760522:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+53:11276:x1875415548338688:12345-192.168.203.13@tcp:101:bash.0 Request processed in 12529us (12714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535935.760530:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1788535935.764220:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1788535935.764796:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535935.764878:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548339072 00000100:00100000:0.0:1788535935.764887:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548339072 00000100:00100000:0.0:1788535935.764945:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1788535935.764955:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf14450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+52:11276:x1875415548339072:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1788535935.765181:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf14450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+53:11276:x1875415548339072:12345-192.168.203.13@tcp:35:bash.0 Request processed in 227us (387us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788535935.765190:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788535935.875939:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535935.876112:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548339328 00000100:00100000:2.0:1788535935.876121:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548339328 00000100:00100000:2.0:1788535935.876210:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1788535935.876220:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+53:11286:x1875415548339328:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788535935.876244:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535935.876269:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdc982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553ef expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535935.876369:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788535935.876467:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdc982 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553ef expref: 55 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.876484:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:2.0:1788535935.876487:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788535935.876492:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdc982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553ef expref: 55 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535935.876506:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460800, rc 0) 00000100:00100000:2.0:1788535935.876561:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+54:11286:x1875415548339328:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 343us (644us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788535935.876569:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:3.0:1788535935.880376:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535935.880464:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548339456 00000100:00100000:0.0:1788535935.880475:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548339456 00000100:00100000:0.0:1788535935.880532:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:0.0:1788535935.880542:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+54:11286:x1875415548339456:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788535935.880614:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880630:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880642:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880671:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880679:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880687:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880788:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880798:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880805:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535935.880849:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880861:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880867:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880873:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880878:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.880882:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880897:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880910:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535935.880913:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535935.880918:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880925:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc990 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880942:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880949:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880956:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880961:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.880964:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880969:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.880977:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936000) 00010000:00010000:0.0:1788535935.880980:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535935.880983:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.881000:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc997 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.881014:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.881021:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.881027:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.881032:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.881036:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.881042:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.881049:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:0.0:1788535935.881052:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535935.881054:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.881059:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc99e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535935.881178:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+54:11286:x1875415548339456:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 604us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535935.881185:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:3.0:1788535935.886528:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535935.886612:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548339712 00000100:00100000:0.0:1788535935.886622:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548339712 00000100:00100000:0.0:1788535935.886731:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1788535935.886751:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+54:11286:x1875415548339712:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788535935.886991:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+55:11286:x1875415548339712:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 250us (470us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788535935.886999:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788535935.944911:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535935.945214:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548339968 00000100:00100000:0.0:1788535935.945225:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548339968 00000100:00100000:0.0:1788535935.945388:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1788535935.945400:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+55:11289:x1875415548339968:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535935.945421:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535935.945441:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc9a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553f6 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945514:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945528:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945538:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945548:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945555:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945573:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945666:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdc9ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945675:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdc9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945683:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdc9ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535935.945692:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788535935.945776:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945785:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945791:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945798:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.945802:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945810:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945823:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535935.945826:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535935.945837:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945844:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdc9ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945873:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945891:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945897:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945906:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.945909:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945915:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945924:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936000) 00010000:00010000:0.0:1788535935.945926:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535935.945929:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945934:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945970:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc9a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553f6 expref: 58 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.945996:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdc9ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553f6 expref: 57 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.946003:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:0.0:1788535935.946005:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535935.946008:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455400, rc 0) 00000100:00100000:0.0:1788535935.946075:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+57:11289:x1875415548339968:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 678us (1177us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788535935.946083:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:3.0:1788535935.954564:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535935.954655:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548340096 00000100:00100000:0.0:1788535935.954666:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548340096 00000100:00100000:0.0:1788535935.954728:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1788535935.954749:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+57:11289:x1875415548340096:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1788535935.954819:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.954835:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.954848:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535935.959627:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535935.960076:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548340224 00000100:00100000:3.0:1788535935.960087:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548340224 00000100:00100000:3.0:1788535935.960171:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1788535935.960181:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+58:2402:x1875415548340224:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535935.960196:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535935.960222:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdc9ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553f6 expref: 58 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535935.960242:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:3.0:1788535935.960246:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535935.960298:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+57:2402:x1875415548340224:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 119us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535935.960305:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00010000:00010000:0.0:1788535935.961725:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.961749:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.961776:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.961782:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535935.961786:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.961794:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.961819:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:0.0:1788535935.961822:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535935.961826:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535935.961832:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535935.961930:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+56:11289:x1875415548340096:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 7190us (7375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535935.961940:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:2.0:1788535935.964088:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535935.964354:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548340480 00000100:00100000:3.0:1788535935.964365:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548340480 00000100:00100000:3.0:1788535935.964420:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1788535935.964430:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+56:11289:x1875415548340480:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788535935.964633:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+57:11289:x1875415548340480:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 204us (552us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788535935.964641:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000040:00080000:0.0:1788535936.044928:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788535936.045814:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788535936.159094:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535936.159321:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548340736 00000100:00100000:0.0:1788535936.159330:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548340736 00000100:00100000:0.0:1788535936.159399:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:0.0:1788535936.159409:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+57:11307:x1875415548340736:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1788535936.159431:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535936.159450:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16553fd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.159568:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc9d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.159582:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.159594:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535936.159605:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788535936.159709:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553fd expref: 60 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.159730:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc9d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553fd expref: 59 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.159751:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:0.0:1788535936.159754:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788535936.159758:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455200, rc 0) 00000100:00100000:0.0:1788535936.159821:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+59:11307:x1875415548340736:12345-192.168.203.13@tcp:101:cat.0 Request processed in 413us (737us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788535936.159828:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00010000:00010000:1.0:1788535936.172324:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535936.202363:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535936.202456:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548340864 00000100:00100000:0.0:1788535936.202466:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548340864 00000100:00100000:0.0:1788535936.202530:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:0.0:1788535936.202540:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+59:11308:x1875415548340864:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535936.202563:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535936.202597:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655404 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.202679:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.202695:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.202708:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535936.202768:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788535936.202772:0:10016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535936.202790:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.202814:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655404 expref: 61 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.202832:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655404 expref: 60 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.202841:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535936.202844:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535936.202848:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455a00, rc 0) 00000100:00100000:0.0:1788535936.202919:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+60:11308:x1875415548340864:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 380us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535936.202925:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:2.0:1788535936.226949:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535936.228751:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548341248 00000100:00100000:3.0:1788535936.228766:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548341248 00000100:00100000:3.0:1788535936.228854:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788535936.228894:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+60:11308:x1875415548341248:12345-192.168.203.13@tcp:35:lfs.0 00000001:00080000:3.0:1788535936.229105:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967352 00000100:00100000:3.0:1788535936.229256:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+62:11308:x1875415548341248:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 378us (2316us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788535936.229264:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000020:00080000:3.0:1788535936.229269:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788535936.237093:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535936.237284:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548341376 00000100:00100000:2.0:1788535936.237294:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548341376 00000100:00100000:2.0:1788535936.237361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788535936.237372:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+62:11308:x1875415548341376:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:2.0:1788535936.237387:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788535936.237413:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdc97b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553e8 expref: 62 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.237455:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdc9d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553fd expref: 61 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.237470:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdc878 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553a2 expref: 60 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.237480:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:2.0:1788535936.237485:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535936.237544:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+59:11308:x1875415548341376:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 175us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.237551:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788535936.240356:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535936.240441:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548341504 00000100:00100000:0.0:1788535936.240461:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548341504 00000100:00100000:0.0:1788535936.240521:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1788535936.240531:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+59:11308:x1875415548341504:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:0.0:1788535936.240666:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.240685:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.240697:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788535936.240969:0:6533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788535936.241096:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788535936.241608:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788535936.241891:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+59:11308:x1875415548341504:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 1346us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535936.241903:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1788535936.289824:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535936.289967:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548341632 00000100:00100000:2.0:1788535936.289977:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548341632 00000100:00100000:2.0:1788535936.290032:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:2.0:1788535936.290042:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+59:11310:x1875415548341632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788535936.290060:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535936.290079:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc9f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165540b expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290178:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290193:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290204:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290231:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290239:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290247:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290326:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290336:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290343:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535936.290382:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788535936.290386:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788535936.290403:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290415:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290423:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290429:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290446:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290452:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535936.290457:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290464:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290477:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:2.0:1788535936.290480:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535936.290485:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290492:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdca00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290506:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290511:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290517:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290522:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535936.290525:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290556:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290565:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936000) 00010000:00010000:2.0:1788535936.290567:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535936.290570:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290575:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdca07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290603:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdc9f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165540b expref: 61 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290616:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165540b expref: 60 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.290623:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:2.0:1788535936.290625:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535936.290628:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461200, rc 0) 00000100:00100000:2.0:1788535936.290691:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+60:11310:x1875415548341632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 650us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.290698:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:2.0:1788535936.942178:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569397248:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.942208:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569397504:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.942250:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.942315:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569397760:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.942340:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535936.942342:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569397248 00000100:00100000:3.0:1788535936.942354:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569397248 00000100:00100000:3.0:1788535936.942405:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569397760 00000100:00100000:3.0:1788535936.942409:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569397760 00000100:00100000:3.0:1788535936.942441:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788535936.942450:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569397248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.942496:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569397248:12345-0@lo:400:kworker.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535936.942503:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788535936.942520:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788535936.942525:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569397760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.942550:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569398272:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.942564:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569397760:12345-0@lo:400:kworker.0 Request processed in 38us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535936.942572:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788535936.942586:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535936.942597:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569398272 00000100:00100000:3.0:1788535936.942602:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569398272 00000100:00100000:3.0:1788535936.942629:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788535936.942644:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569397248:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.942649:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569398272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.942659:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569397760:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.942680:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788535936.942689:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569397376:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.942699:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569398272:12345-0@lo:400:kworker.0 Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535936.942706:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788535936.942719:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788535936.942745:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535936.942758:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569397888:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.942764:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.942787:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535936.942789:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569398016:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.942812:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569398400:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.942823:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.942843:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535936.942847:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569398528:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.942874:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569398272:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.942877:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.942904:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569397376 00000100:00100000:2.0:1788535936.942908:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569397376 00000100:00100000:3.0:1788535936.942914:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788535936.942922:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569397120:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.942941:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788535936.942949:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569397376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.942962:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535936.942990:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569397632:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.943006:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569397376:12345-0@lo:400:kworker.0 Request processed in 57us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.943014:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788535936.943042:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569397376:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.943305:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569398016 00000100:00100000:2.0:1788535936.943310:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569398016 00000100:00100000:2.0:1788535936.943339:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569398528 00000100:00100000:2.0:1788535936.943342:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569398528 00000100:00100000:2.0:1788535936.943357:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788535936.943370:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569398016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.943420:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535936.943442:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569398144:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.943465:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535936.943476:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569398656:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.943506:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535936.943528:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569398144 00000100:00100000:3.0:1788535936.943531:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569398144 00000100:00100000:3.0:1788535936.944336:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569398656 00000100:00100000:3.0:1788535936.944342:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569398656 00000100:00100000:3.0:1788535936.944368:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788535936.944376:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569398528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.944412:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569398528:12345-0@lo:400:kworker.0 Request processed in 37us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535936.944428:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788535936.944443:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788535936.944448:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1875415569398144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.944454:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569398016:12345-0@lo:400:kworker.0 Request processed in 1013us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.944464:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788535936.944482:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1875415569398144:12345-0@lo:400:kworker.0 Request processed in 33us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.944487:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788535936.944496:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788535936.944500:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569398656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.944524:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569397632 00000100:00100000:3.0:1788535936.944529:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569397632 00000100:00100000:2.0:1788535936.944537:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569398656:12345-0@lo:400:kworker.0 Request processed in 40us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.944544:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788535936.944564:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788535936.944572:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569397632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.944589:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569397504 00000100:00100000:2.0:1788535936.944594:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569397504 00000100:00100000:3.0:1788535936.944609:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569397632:12345-0@lo:400:kworker.0 Request processed in 38us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535936.944615:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788535936.944635:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569397120 00000100:00100000:3.0:1788535936.944639:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569397120 00000100:00100000:3.0:1788535936.944666:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788535936.944671:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569397120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.944701:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569397120:12345-0@lo:400:kworker.0 Request processed in 29us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535936.944706:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788535936.944763:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569397888 00000100:00100000:3.0:1788535936.944767:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569397888 00000100:00100000:3.0:1788535936.944784:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569398400 00000100:00100000:3.0:1788535936.944787:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569398400 00000100:00100000:3.0:1788535936.944800:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788535936.944805:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569397888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.944848:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569397888:12345-0@lo:400:kworker.0 Request processed in 42us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535936.944854:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788535936.944867:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788535936.944873:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569398400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.945316:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569398400:12345-0@lo:400:kworker.0 Request processed in 442us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535936.945324:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1788535936.945512:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535936.945517:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535936.945520:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788535936.945785:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90058ad6ca80 x1875415569397888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535936.945800:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569397888:0@lo:400:kworker.0 00010000:00080000:3.0:1788535936.945815:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90058ad6dc00 x1875415569398400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535936.945823:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569398400:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.945857:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569397120:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.945867:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569397632:0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.946286:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788535936.946298:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569397504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535936.946344:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569397504:12345-0@lo:400:kworker.0 Request processed in 50us (3580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535936.946350:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788535936.946948:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569398144:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.947363:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569398656:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.947380:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569397504:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.947407:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569398016:0@lo:400:kworker.0 00000100:00100000:3.0:1788535936.947418:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569398528:0@lo:400:kworker.0 00000001:00080000:0.0:1788535936.952916:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1788535936.952966:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788535936.952990:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90048818aa80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788535936.952995:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff900487ac7400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90048818a540 00000020:00080000:0.0:1788535936.952998:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90058f964700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff900486ae9c00 00010000:00010000:3.0:1788535936.953548:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953560:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953568:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953574:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535936.953579:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953588:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953605:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff900486936d00) 00010000:00010000:3.0:1788535936.953678:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535936.953684:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953692:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdc7b4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953716:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953722:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953752:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953757:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535936.953760:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953766:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953774:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:3.0:1788535936.953777:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535936.953779:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953785:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdc7bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953800:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953807:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953812:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953817:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535936.953819:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953835:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953844:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936000) 00010000:00010000:3.0:1788535936.953846:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535936.953849:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953854:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdc7fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953870:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953876:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953882:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953887:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535936.953890:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953896:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953903:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:3.0:1788535936.953905:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535936.953908:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953922:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdc904 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953934:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953941:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953947:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953952:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535936.953955:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953961:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953969:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:3.0:1788535936.953971:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535936.953974:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953980:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdc927 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953989:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.953995:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.954005:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.954009:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535936.954012:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.954017:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.954024:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:3.0:1788535936.954026:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535936.954028:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535936.954033:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdc96d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788535936.954347:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788535936.954500:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788535936.954510:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535936.954528:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569398784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788535936.954592:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535936.954637:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569398784 00000100:00100000:2.0:1788535936.954644:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569398784 00000100:00100000:2.0:1788535936.954683:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788535936.954691:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3663:x1875415569398784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788535936.954715:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788535936.954758:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ae47e, atime: 0x6a9ae47e, ctime: 0x6a9ae47e, blocks: 0x8 00010000:00010000:2.0:1788535936.954765:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.954779:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=395s v=(0 0) 00010000:00010000:2.0:1788535936.954783:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535936.954790:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.954804:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.954812:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.954819:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535936.954841:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788535936.954955:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3663:x1875415569398784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 264us (362us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788535936.954963:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:2.0:1788535936.955002:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff900488397100/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788535936.955008:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569398784:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788535936.955166:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535936.955172:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.955180:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460600 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788535936.955183:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.955199:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.955212:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.955219:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dd7d383/0xe79af2f39bbdca15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535936.955235:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535936.955237:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535936.955239:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788535937.068472:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535937.068480:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535937.068520:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788535937.068532:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535937.068697:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488396300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569398912:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788535937.068807:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058db57a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535937.073467:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488396300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569398912:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788535937.085110:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535937.085304:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548341760 00000100:00100000:0.0:1788535937.085314:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548341760 00000100:00100000:0.0:1788535937.085384:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1788535937.085395:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+12:11321:x1875415548341760:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788535937.085423:0:10016:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788535937.085540:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+12:11321:x1875415548341760:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 146us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535937.085547:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00080000:3.0:1788535937.085723:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535937.090236:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.090372:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548341888 00000100:00100000:3.0:1788535937.090381:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548341888 00000100:00100000:3.0:1788535937.090439:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:3.0:1788535937.090449:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+12:11321:x1875415548341888:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788535937.090523:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090540:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090550:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090623:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090632:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090639:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090667:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090676:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090683:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535937.090724:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788535937.090739:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788535937.090753:0:6533:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090765:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090772:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090779:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090795:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535937.090800:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090806:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090817:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:3.0:1788535937.090820:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535937.090824:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090830:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdca1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090842:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090858:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090863:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090869:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535937.090871:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090877:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090894:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff900486936000) 00010000:00010000:3.0:1788535937.090897:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535937.090899:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090905:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdca23 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090920:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090925:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090931:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090934:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535937.090937:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090942:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090948:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:3.0:1788535937.090951:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535937.090953:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.090959:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.091043:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+12:11321:x1875415548341888:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 594us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535937.091051:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:2.0:1788535937.093348:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.093434:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548342144 00000100:00100000:3.0:1788535937.093442:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548342144 00000100:00100000:3.0:1788535937.093539:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1788535937.093549:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+12:11321:x1875415548342144:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535937.093568:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535937.093586:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdca31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655412 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093681:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093695:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093706:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535937.093716:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788535937.093808:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093816:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093822:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093840:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535937.093845:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093853:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093864:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:3.0:1788535937.093867:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535937.093872:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093878:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093943:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdca31 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655412 expref: 14 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093954:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:3.0:1788535937.093956:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535937.093959:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdca31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655412 expref: 14 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.093969:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50800, rc 0) 00000100:00100000:3.0:1788535937.094019:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+13:11321:x1875415548342144:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 472us (680us total) trans 4294967354 rc 301/301 00000100:00100000:3.0:1788535937.094027:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1788535937.107346:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535937.116296:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548342272 00000100:00100000:2.0:1788535937.116312:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548342272 00000100:00100000:2.0:1788535937.116367:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:2.0:1788535937.116377:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+13:11321:x1875415548342272:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788535937.116409:0:6535:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788535937.116525:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+13:11321:x1875415548342272:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 149us (9189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535937.116533:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:3.0:1788535937.125621:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.125656:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548342528 00000100:00100000:3.0:1788535937.125665:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548342528 00000100:00100000:3.0:1788535937.125712:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:3.0:1788535937.125722:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+13:11321:x1875415548342528:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535937.125753:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535937.125756:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788535937.125783:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdc9eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655404 expref: 13 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.125800:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:3.0:1788535937.125805:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535937.125859:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdca46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655419 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535937.127534:0:6534:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788535937.130446:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.130478:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.130489:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.130559:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdca46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655419 expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.130584:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655419 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.130599:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff900486936000) 00010000:00010000:3.0:1788535937.130602:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535937.130606:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51400, rc 0) 00000100:00100000:3.0:1788535937.130676:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+14:11321:x1875415548342528:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 4955us (5075us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788535937.130684:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:3.0:1788535937.141349:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.141381:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548342784 00000100:00100000:3.0:1788535937.141390:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548342784 00000100:00100000:3.0:1788535937.141438:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:3.0:1788535937.141449:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+14:11321:x1875415548342784:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788535937.141505:0:10112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535937.141531:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdca4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655419 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141550:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff900486936000) 00010000:00010000:3.0:1788535937.141562:0:10112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535937.141583:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141596:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141606:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141665:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141683:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141691:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141744:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141751:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141758:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141764:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535937.141767:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141774:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141782:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:3.0:1788535937.141785:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535937.141788:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141794:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdca5b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141803:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141815:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141820:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141825:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535937.141828:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141834:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141843:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xcf568e10 (ffff900486936d00) 00010000:00010000:3.0:1788535937.141846:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535937.141848:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.141854:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca62 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcf568e10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.141927:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+13:11321:x1875415548342784:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 480us (587us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788535937.141935:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:3.0:1788535937.145284:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535937.145575:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548342912 00000100:00100000:0.0:1788535937.145584:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548342912 00000100:00100000:0.0:1788535937.145639:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:0.0:1788535937.145649:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+13:11321:x1875415548342912:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535937.145680:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535937.145702:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdca69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655420 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.145744:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.145757:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.145768:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.145871:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdca69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655420 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.145891:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655420 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.145899:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:0.0:1788535937.145902:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788535937.145905:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455a00, rc 0) 00000100:00100000:0.0:1788535937.145963:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+14:11321:x1875415548342912:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 315us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535937.145970:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:3.0:1788535937.151341:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535937.151419:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548343168 00000100:00100000:0.0:1788535937.151429:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548343168 00000100:00100000:0.0:1788535937.151486:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:0.0:1788535937.151496:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+14:11321:x1875415548343168:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788535937.151586:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.151602:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.151613:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788535937.151777:0:10016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788535937.151787:0:10016:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395955639781ns, next at 396955637178ns, rc = 0 00000004:00010000:0.0:1788535937.151836:0:10016:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000523652fa reply state 000000001cf492c8 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.151850:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.151857:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:0.0:1788535937.151859:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788535937.151863:0:10016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788535937.151955:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11321:x1875415548343168:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 460us (623us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788535937.151962:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:1.0:1788535937.154498:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.154675:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548343296 00000100:00100000:3.0:1788535937.154684:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548343296 00000100:00100000:3.0:1788535937.154747:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:3.0:1788535937.154764:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11321:x1875415548343296:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535937.154788:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535937.154816:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655427 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.154877:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655427 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.154893:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655427 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.154910:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:3.0:1788535937.154913:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535937.154917:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3e200, rc 0) 00000100:00100000:3.0:1788535937.154977:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+17:11321:x1875415548343296:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 215us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535937.154984:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:3.0:1788535937.161231:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535937.161393:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548343424 00000100:00100000:0.0:1788535937.161403:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548343424 00000100:00100000:0.0:1788535937.161445:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1788535937.161452:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875415548343424:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788535937.161483:0:10017:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:0.0:1788535937.161511:0:10017:0:(genops.c:1385:class_connect()) connect: client b9ef506c-5095-4495-a34a-e3b5845d008a, cookie 0xe79af2f39bbdca85 00002000:00100000:0.0:1788535937.161528:0:10017:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b9ef506c-5095-4495-a34a-e3b5845d008a/ffff9004883a7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788535937.161543:0:10017:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788535937.161618:0:10017:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788535937.161646:0:10017:0:(import.c:65:import_set_state_nolock()) ffff9004883a1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788535937.161706:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2398:x1875415548343424:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 Request processed in 253us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535937.161714:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1788535937.164361:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535937.164549:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548343552 00000100:00100000:2.0:1788535937.164560:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548343552 00000100:00100000:2.0:1788535937.164636:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1788535937.164648:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:0:x1875415548343552:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788535937.164905:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788535937.174542:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1788535937.174557:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000100:00100000:0.0:1788535937.174749:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:0:x1875415548343552:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 10098us (10392us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788535937.174760:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1788535937.192032:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.192099:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548343808 00000100:00100000:3.0:1788535937.192108:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548343808 00000100:00100000:3.0:1788535937.192335:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788535937.192346:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+17:11321:x1875415548343808:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788535937.192534:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:11321:x1875415548343808:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 186us (506us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788535937.192551:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:1.0:1788535937.196782:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535937.198074:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535937.198180:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548344064 00000100:00100000:1.0:1788535937.198189:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548344064 00000100:00100000:1.0:1788535937.198240:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:1.0:1788535937.198250:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:11321:x1875415548344064:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788535937.198348:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:11321:x1875415548344064:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 99us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535937.198355:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:1.0:1788535937.209851:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.210016:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548344192 00000100:00100000:3.0:1788535937.210026:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548344192 00000100:00100000:3.0:1788535937.210086:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:3.0:1788535937.210097:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+18:11321:x1875415548344192:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535937.210117:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535937.210139:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdca8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165542e expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.210252:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.210267:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.210280:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535937.210320:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788535937.210338:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.210362:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdca8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165542e expref: 20 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.210379:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165542e expref: 19 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.210420:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:3.0:1788535937.210422:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788535937.210426:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51200, rc 0) 00000100:00100000:3.0:1788535937.210480:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11321:x1875415548344192:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 385us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535937.210488:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:1.0:1788535937.213415:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535937.213463:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548344320 00000100:00100000:0.0:1788535937.213472:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548344320 00000100:00100000:0.0:1788535937.213532:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1788535937.213541:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548344320:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535937.213558:0:10017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535937.213579:0:10017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655435 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535937.213604:0:10017:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae481, blocks: 0x0 00010000:00010000:0.0:1788535937.213622:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1788535937.213626:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535937.213635:0:10017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655435 expref: 6 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.213655:0:10017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655435 expref: 6 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.213685:0:10017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454600, rc 0) 00000100:00100000:0.0:1788535937.213751:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548344320:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 211us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535937.213758:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1788535937.219958:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.220042:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548344576 00000100:00100000:3.0:1788535937.220051:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548344576 00000100:00100000:3.0:1788535937.220136:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:3.0:1788535937.220175:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11321:x1875415548344576:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788535937.220273:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11321:x1875415548344576:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535937.220281:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:1.0:1788535937.228055:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535937.228318:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548344704 00000100:00100000:2.0:1788535937.228327:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548344704 00000100:00100000:2.0:1788535937.228489:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1788535937.228500:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:11321:x1875415548344704:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535937.228518:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535937.228537:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165543c expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.228575:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655435 expref: 7 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.228584:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535937.228589:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535937.228594:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.228637:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655435 expref: 7 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.228651:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655435 expref: 7 pid: 10017 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535937.228665:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488395880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8446:1875415569399040:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535937.228760:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788535937.232083:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.232595:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548344832 00000100:00100000:3.0:1788535937.232603:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548344832 00010000:00010000:3.0:1788535937.232654:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655435 expref: 8 pid: 10017 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.232693:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1788535937.232703:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2402:x1875415548344832:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535937.232717:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535937.232749:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655435 expref: 8 pid: 10017 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.232781:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655435 expref: 8 pid: 10017 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.232815:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535937.232820:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535937.232829:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.232849:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.233063:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.233078:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6520:1875415569399168:192.168.203.13@tcp:105: 00000100:00100000:3.0:1788535937.233253:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17540 going to sleep for 11 seconds 00010000:00010000:3.0:1788535937.233292:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdca9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655435 expref: 8 pid: 10017 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.233308:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488395880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8446:1875415569399040:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535937.233330:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.233340:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460a00, rc 0) 00000100:00100000:3.0:1788535937.233374:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+7:11321:x1875415548344704:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 4877us (5329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535937.233381:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788535937.237767:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535937.237837:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548344960 00000100:00100000:2.0:1788535937.237845:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548344960 00002000:00100000:2.0:1788535937.237889:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90059fb77b80 x1875415548344960/t0(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:593/0 lens 504/0 e 0 to 0 dl 1788535948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535937.237899:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fb77b80 with x1875415548344960 ext(0->8) 00002000:00010000:2.0:1788535937.237904:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fb77b80 00000100:00100000:2.0:1788535937.237934:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1788535937.237948:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548344960:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788535937.239298:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6520:1875415569399168:192.168.203.13@tcp:105: 00010000:00010000:3.0:1788535937.239324:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535937.239380:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488395f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548344832:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 6677us (7304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535937.239465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1788535937.243767:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2402:x1875415548344960:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 5810us (5997us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788535937.243779:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:2.0:1788535937.243790:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90059fb77b80 x1875415548344960/t4294967303(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:593/0 lens 504/448 e 0 to 0 dl 1788535948 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535937.243801:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fb77b80 with x1875415548344960 ext(0->8) 00002000:00010000:2.0:1788535937.243807:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fb77b80 00000100:00100000:1.0:1788535937.249186:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.249313:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548345088 00000100:00100000:3.0:1788535937.249322:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548345088 00000100:00100000:3.0:1788535937.249379:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:3.0:1788535937.249396:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11321:x1875415548345088:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788535937.254029:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:2.0:1788535937.254043:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1788535937.254055:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788535937.254063:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1788535937.254068:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.254077:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.254083:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00000020:00080000:2.0:1788535937.254085:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1788535937.254088:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788535937.254094:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1788535937.254095:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.254120:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:3.0:1788535937.254130:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788535937.254136:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.254143:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdca77 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535937.254321:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569399296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788535937.254350:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+15:11321:x1875415548345088:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 4961us (5202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535937.254358:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:1.0:1788535937.254367:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535937.254426:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569399296 00000100:00100000:1.0:1788535937.254433:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569399296 00000100:00100000:1.0:1788535937.254479:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788535937.254488:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569399296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788535937.254723:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788535937.254737:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788535937 00002000:00010000:1.0:1788535937.254740:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788535937.254742:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788535937 -> 1788535937 00002000:00010000:1.0:1788535937.254751:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788535937.254793:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3663:x1875415569399296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 306us (424us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788535937.254800:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1788535937.256249:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff900488821880/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788535937.256259:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569399296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788535937.257724:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.257803:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548345216 00000100:00100000:3.0:1788535937.257811:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548345216 00000100:00100000:3.0:1788535937.257943:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1788535937.257955:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548345216:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788535937.261305:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788535937.261317:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788535937.261601:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548345216:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 3644us (3877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535937.261658:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1788535937.265327:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535937.265400:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548345472 00000100:00100000:0.0:1788535937.265409:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548345472 00000100:00100000:0.0:1788535937.265466:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1788535937.265476:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+14:11321:x1875415548345472:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788535937.265524:0:10112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535937.265553:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdca93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165542e expref: 14 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.265572:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:0.0:1788535937.265576:0:10112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535937.265604:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.265618:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.265627:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535937.265750:0:10112:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000e2d0b381 reply state 00000000ba9f826c transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.265774:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.265780:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:0.0:1788535937.265783:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788535937.265786:0:10112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788535937.265863:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+15:11321:x1875415548345472:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 388us (545us total) trans 4294967358 rc 0/0 00000100:00100000:0.0:1788535937.265870:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:1.0:1788535937.271693:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535937.273279:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548345600 00000100:00100000:2.0:1788535937.273292:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548345600 00000100:00100000:2.0:1788535937.273349:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788535937.273359:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548345600:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788535937.273505:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788535937.273515:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788535937 -> 1788535936 00002000:00010000:2.0:1788535937.273518:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788535934 00002000:00010000:2.0:1788535937.273521:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788535937 -> 1788535936 00002000:00010000:2.0:1788535937.273523:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788535937.273594:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548345600:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 236us (1910us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788535937.273603:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1788535937.294922:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.294953:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548345856 00000100:00100000:3.0:1788535937.294961:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548345856 00000100:00100000:3.0:1788535937.295004:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:3.0:1788535937.295012:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+15:11321:x1875415548345856:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788535937.295073:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.295089:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655420 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.295099:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.295129:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655420 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.295142:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655420 expref: 15 pid: 6533 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.295180:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569399424:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535937.295249:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535937.305956:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569399424:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535937.305984:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.307715:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535937.307778:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548345984 00000100:00100000:1.0:1788535937.307787:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548345984 00010000:00010000:1.0:1788535937.307822:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655420 expref: 16 pid: 6533 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535937.307855:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1788535937.307864:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+16:2401:x1875415548345984:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535937.307876:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535937.307882:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655420 expref: 16 pid: 6533 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.307895:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655420 expref: 16 pid: 6533 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.307928:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdca70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655420 expref: 16 pid: 6533 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.307944:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:1.0:1788535937.307949:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.307968:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.307975:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.308000:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535937.308041:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535937.308050:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+15:2401:x1875415548345984:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 186us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535937.308064:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00010000:00010000:3.0:1788535937.308066:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.308110:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.308118:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.308124:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.308130:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535937.308135:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.308171:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.308192:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:3.0:1788535937.308203:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788535937.308208:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.308214:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcaaf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.308272:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+14:11321:x1875415548345856:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 13260us (13360us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788535937.308281:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000040:00080000:2.0:1788535937.308850:0:14220:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535937.308855:0:14220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535937.308878:0:14220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788535937.308884:0:14220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788535937.319233:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535937.319276:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548346112 00000100:00100000:2.0:1788535937.319287:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548346112 00000100:00100000:2.0:1788535937.319339:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1788535937.319348:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2400:x1875415548346112:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788535937.319388:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.319409:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.319418:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535937.319423:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788535937.319428:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.319462:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.319487:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 7 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535937.319501:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8446:1875415569399552:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535937.319582:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bb8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788535937.339295:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535937.339395:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548346240 00000100:00100000:1.0:1788535937.339406:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548346240 00010000:00010000:1.0:1788535937.339455:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 8 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535937.339494:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1788535937.339502:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2402:x1875415548346240:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535937.339516:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535937.339535:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 8 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.339547:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 8 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.339570:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535937.339575:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535937.339581:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.339598:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.339617:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535937.339664:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2402:x1875415548346240:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 163us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535937.339671:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00010000:00010000:3.0:1788535937.341193:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba9392a/0xe79af2f39bbdcaa1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165543c expref: 7 pid: 8446 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.341213:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8446:1875415569399552:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535937.341250:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.341262:0:8446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.341270:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.341299:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.341322:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.341330:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.341338:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460600 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:3.0:1788535937.341342:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.341351:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.341367:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.341375:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dd7d383/0xe79af2f39bbdcab6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.341465:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2400:x1875415548346112:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 22117us (22240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535937.341475:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1788535937.363484:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.363615:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548346496 00000100:00100000:3.0:1788535937.363623:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548346496 00000100:00100000:3.0:1788535937.363676:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:3.0:1788535937.363694:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+14:11321:x1875415548346496:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788535937.363774:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.363789:0:10016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553c5 expref: 14 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.363798:0:10016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.363829:0:10016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553c5 expref: 14 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.363841:0:10016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553c5 expref: 14 pid: 10016 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.363854:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569399680:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535937.363927:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535937.371797:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535937.371831:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548346624 00000100:00100000:1.0:1788535937.371840:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548346624 00010000:00010000:1.0:1788535937.371890:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553c5 expref: 15 pid: 10016 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535937.371927:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1788535937.371937:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfa9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+15:2402:x1875415548346624:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535937.372111:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535937.372120:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553c5 expref: 15 pid: 10016 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.372135:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553c5 expref: 15 pid: 10016 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.372180:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535937.372186:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.372210:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.372218:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.372238:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535937.372287:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfa9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+15:2402:x1875415548346624:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 351us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535937.372294:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00010000:00010000:3.0:1788535937.373993:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdc8fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16553c5 expref: 14 pid: 10016 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.374026:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569399680:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535937.374049:0:10016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.374059:0:10016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.374081:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.374331:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.374346:0:10016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655427 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.374355:0:10016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.374389:0:10016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655427 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535937.374405:0:10016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655427 expref: 14 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535937.374419:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569399808:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535937.374487:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17900 going to sleep for 11 seconds 00000100:00100000:1.0:1788535937.385325:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.385993:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569399808:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535937.386035:0:10016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535937.386184:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548346752 00000100:00100000:2.0:1788535937.386192:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548346752 00010000:00010000:2.0:1788535937.386238:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655427 expref: 15 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535937.386279:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788535937.386289:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+15:2401:x1875415548346752:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535937.386306:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535937.386313:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655427 expref: 15 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.386325:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655427 expref: 15 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.386346:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdca7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655427 expref: 15 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.386363:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:2.0:1788535937.386368:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.386393:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.386401:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.386429:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535937.386485:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+14:2401:x1875415548346752:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 197us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535937.386493:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00010000:00010000:2.0:1788535937.386518:0:10016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.386526:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535937.386641:0:10016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788535937.386770:0:10016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:2.0:1788535937.386806:0:10016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788535937.386878:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488394a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10016:1875415569399936:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788535937.386930:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535937.386960:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058509a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788535937.386979:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569399936 00000100:00100000:2.0:1788535937.386982:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569399936 00000100:00100000:2.0:1788535937.387013:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788535937.387035:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10016:x1875415569399936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788535937.387105:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10016:x1875415569399936:12345-0@lo:1000:mdt00_003.0 Request processed in 72us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535937.387112:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788535937.387180:0:10016:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788535937.387185:0:10016:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff900488821880, transno 4294967304 00000100:00100000:2.0:1788535937.387198:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488394a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10016:1875415569399936:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788535937.387301:0:10016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:2.0:1788535937.387337:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488394a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10016:1875415569400064:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788535937.387363:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535937.387377:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058509a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788535937.387450:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569400064 00000100:00100000:2.0:1788535937.387454:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569400064 00000100:00100000:2.0:1788535937.387477:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788535937.387483:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10016:x1875415569400064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788535937.387572:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10016:x1875415569400064:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (207us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788535937.387579:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788535937.387610:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488394a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10016:1875415569400064:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788535937.387637:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387647:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387654:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387660:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535937.387665:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387673:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387694:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:2.0:1788535937.387696:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535937.387700:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387707:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcac4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387746:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387754:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387758:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387763:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535937.387766:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387772:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387780:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:2.0:1788535937.387782:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535937.387785:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387791:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdc9f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387824:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387836:0:10016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165540b expref: 17 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387845:0:10016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387867:0:10016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165540b expref: 17 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.387880:0:10016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165540b expref: 17 pid: 10112 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535937.387891:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569400192:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535937.387937:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004881056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535937.401556:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535937.401585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548346880 00000100:00100000:1.0:1788535937.401594:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548346880 00010000:00010000:1.0:1788535937.401634:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165540b expref: 18 pid: 10112 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535937.401669:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788535937.401679:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+18:2402:x1875415548346880:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535937.401696:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535937.401703:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165540b expref: 18 pid: 10112 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.401717:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165540b expref: 18 pid: 10112 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.401751:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535937.401770:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.401781:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.401789:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.401808:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535937.401854:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+18:2402:x1875415548346880:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 176us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535937.401861:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00010000:00010000:1.0:1788535937.402006:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdca0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165540b expref: 17 pid: 10112 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535937.402705:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569400192:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535937.402759:0:10016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402769:0:10016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402774:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402785:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402792:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402809:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402816:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535937.402820:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402828:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402840:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535937.402843:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535937.402847:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402853:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcacb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402864:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402870:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402875:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402880:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535937.402883:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402898:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402907:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90059d464400) 00010000:00010000:1.0:1788535937.402909:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788535937.402912:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535937.402917:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcabd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535937.403072:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11321:x1875415548346496:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 39378us (39597us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788535937.403081:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000020:00080000:1.0:1788535937.403086:0:10016:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788535937.403197:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535937.403202:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535937.403215:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788535937.403235:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788535937.409717:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535937.410243:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548347136 00000100:00100000:3.0:1788535937.410255:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548347136 00000100:00100000:3.0:1788535937.410318:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788535937.410356:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11321:x1875415548347136:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788535937.410815:0:6537:0:(mdd_object.c:4338:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788535937.410857:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:0.0:1788535937.411040:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.411055:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.411066:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.411075:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.411080:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.411087:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535937.412023:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788535937.412129:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:11321:x1875415548347136:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1795us (2420us total) trans 4294967365 rc 0/0 00010000:00010000:2.0:1788535937.412131:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535937.412141:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535937.412142:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000020:00080000:0.0:1788535937.412167:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788535937.412172:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788535937.412178:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.412187:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.412202:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:2.0:1788535937.412212:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788535937.412218:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.412224:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcad2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535937.412238:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535937.412240:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535937.412243:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535937.452307:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569400320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535937.452396:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535937.452476:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569400320 00000100:00100000:0.0:1788535937.452484:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569400320 00000100:00100000:0.0:1788535937.452532:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788535937.452543:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569400320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535937.452567:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788535937.452614:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569400320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535937.452622:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788535937.452671:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569400320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535937.453003:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569400448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535937.453035:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535937.453109:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569400448 00000100:00100000:1.0:1788535937.453114:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569400448 00000100:00100000:1.0:1788535937.453172:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788535937.453180:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569400448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535937.453192:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788535937.453225:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569400448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535937.453232:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788535937.453318:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569400448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788535938.224712:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535938.476376:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535938.476399:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569400576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535938.476467:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535938.476676:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569400576 00000100:00100000:3.0:1788535938.476691:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569400576 00000100:00100000:3.0:1788535938.476767:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788535938.476778:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3663:x1875415569400576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535938.476807:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535938.476854:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3663:x1875415569400576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535938.476861:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788535938.476961:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535938.476999:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569400576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535938.478194:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569400704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535938.478244:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535938.478702:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569400704 00000100:00100000:1.0:1788535938.478710:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569400704 00000100:00100000:1.0:1788535938.478779:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788535938.478787:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569400704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788535938.478803:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535938.478847:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569400704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535938.478854:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1788535938.479223:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535938.479260:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569400704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535938.988387:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569400832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535938.988452:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535938.988979:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569400832 00000100:00100000:2.0:1788535938.988987:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569400832 00000100:00100000:2.0:1788535938.989039:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788535938.989048:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569400832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788535938.989080:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788535938.989142:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569400832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535938.989165:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788535938.989210:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569400832:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788535939.200953:0:14272:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535939.200964:0:14272:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535939.200990:0:14272:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788535939.200996:0:14272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788535939.244371:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535939.334846:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535939.337334:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548347392 00000100:00100000:2.0:1788535939.337348:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548347392 00000100:00100000:2.0:1788535939.337419:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:2.0:1788535939.337429:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:11339:x1875415548347392:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788535939.337451:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535939.337517:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655443 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.337616:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdcae0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.337630:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdcae0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.337641:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdcae0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535939.337650:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788535939.337764:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655443 expref: 21 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.337782:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdcae0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655443 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.337792:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:2.0:1788535939.337794:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788535939.337798:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460600, rc 0) 00000100:00100000:2.0:1788535939.337859:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+20:11339:x1875415548347392:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 431us (3020us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788535939.337879:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00080000:2.0:1788535939.337903:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535939.342874:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535939.342954:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548347520 00000100:00100000:0.0:1788535939.342963:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548347520 00000100:00100000:0.0:1788535939.343028:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:0.0:1788535939.343038:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+20:11339:x1875415548347520:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788535939.343118:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343135:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343180:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343241:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343249:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343255:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343327:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343335:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343342:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535939.343382:0:6533:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343393:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343405:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343411:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343416:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535939.343420:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343426:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343438:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535939.343441:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535939.343445:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343451:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcaee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343462:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343468:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343472:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343476:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535939.343484:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343490:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343496:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9005893b0c00) 00010000:00010000:0.0:1788535939.343499:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535939.343501:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343506:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcaf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343519:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343525:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343530:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343535:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535939.343538:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343544:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343550:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0500) 00010000:00010000:0.0:1788535939.343551:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535939.343561:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.343567:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcafc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535939.343639:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+20:11339:x1875415548347520:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 602us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535939.343647:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1788535939.398537:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535939.398607:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548347776 00000100:00100000:0.0:1788535939.398617:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548347776 00000100:00100000:0.0:1788535939.398677:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:0.0:1788535939.398687:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+20:11342:x1875415548347776:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535939.398705:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535939.398735:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcb03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165544a expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.398809:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.398822:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.398833:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.398847:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.398855:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.398874:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.398975:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.398983:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.398990:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535939.398999:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788535939.399070:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399078:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399085:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399091:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535939.399094:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399101:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399111:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535939.399114:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535939.399126:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399132:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcb0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399143:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399179:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399184:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399189:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535939.399192:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399198:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399205:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9005893b0500) 00010000:00010000:0.0:1788535939.399207:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535939.399210:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399216:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399255:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcb03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165544a expref: 23 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399281:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165544a expref: 22 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.399288:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:0.0:1788535939.399291:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535939.399293:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455a00, rc 0) 00000100:00100000:0.0:1788535939.399347:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11342:x1875415548347776:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 661us (819us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788535939.399354:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:1.0:1788535939.414933:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535939.415573:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548347904 00000100:00100000:2.0:1788535939.415582:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548347904 00000100:00100000:2.0:1788535939.415638:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:2.0:1788535939.415648:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11342:x1875415548347904:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788535939.415708:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.415735:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.415747:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.415788:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.415795:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.415802:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.415808:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535939.415812:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.415820:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.415991:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:2.0:1788535939.415994:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788535939.415999:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.416006:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535939.416079:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11342:x1875415548347904:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 431us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535939.416087:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:0.0:1788535939.421041:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.421254:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548348160 00000100:00100000:1.0:1788535939.421264:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548348160 00000100:00100000:1.0:1788535939.421310:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1788535939.421318:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11342:x1875415548348160:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788535939.421527:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+23:11342:x1875415548348160:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 208us (494us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788535939.421535:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1788535939.454654:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535939.454746:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548348416 00000100:00100000:0.0:1788535939.454764:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548348416 00000100:00100000:0.0:1788535939.454817:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1788535939.454826:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+23:10860:x1875415548348416:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788535939.454846:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535939.454872:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcb2d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655451 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.455215:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.455230:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165544a expref: 24 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.455239:0:10112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.455345:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165544a expref: 24 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.455358:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165544a expref: 24 pid: 10016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535939.455371:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb76300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569400960:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535939.455491:0:10112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005acace900 going to sleep for 11 seconds 00000100:00100000:0.0:1788535939.460316:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb76300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569400960:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535939.460346:0:10112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535939.461540:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535939.461636:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548348544 00000100:00100000:2.0:1788535939.461646:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548348544 00010000:00010000:2.0:1788535939.461772:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165544a expref: 25 pid: 10016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535939.461812:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:2.0:1788535939.461823:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+25:2402:x1875415548348544:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535939.461838:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535939.461845:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165544a expref: 25 pid: 10016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.461857:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165544a expref: 25 pid: 10016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.461878:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcb18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165544a expref: 25 pid: 10016 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.461913:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:2.0:1788535939.461917:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.461927:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.461934:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.462508:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535939.462567:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+24:2402:x1875415548348544:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 745us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535939.462575:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00010000:00010000:0.0:1788535939.462638:0:10112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.462647:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535939.462666:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788535939.462869:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcb2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655451 expref: 25 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.462886:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655451 expref: 24 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.462895:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:0.0:1788535939.462897:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788535939.462908:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454600, rc 0) 00000100:00100000:0.0:1788535939.462933:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+24:10860:x1875415548348416:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8108us (8289us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788535939.462940:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:3.0:1788535939.465371:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535939.472571:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548348672 00000100:00100000:2.0:1788535939.472586:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548348672 00000100:00100000:2.0:1788535939.472710:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:2.0:1788535939.472732:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+24:10860:x1875415548348672:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788535939.472757:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535939.472792:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655458 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.472836:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcb49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.472849:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.472880:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.473000:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461e00/0xe79af2f39bbdcb42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655458 expref: 26 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.473018:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcb49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655458 expref: 25 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.473027:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:2.0:1788535939.473029:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788535939.473033:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461800, rc 0) 00000100:00100000:2.0:1788535939.473098:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+25:10860:x1875415548348672:12345-192.168.203.13@tcp:101:bash.0 Request processed in 369us (7734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535939.473105:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:3.0:1788535939.477098:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.478389:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548348928 00000100:00100000:1.0:1788535939.478402:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548348928 00000100:00100000:1.0:1788535939.478510:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:1.0:1788535939.478520:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+25:10860:x1875415548348928:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:1.0:1788535939.478773:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.478813:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.478826:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535939.478883:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:1.0:1788535939.478906:0:6533:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000bc502d36 reply state 0000000060259809 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.478919:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.478926:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:1.0:1788535939.478929:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788535939.478932:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788535939.478977:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:1.0:1788535939.479088:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+29:10860:x1875415548348928:12345-192.168.203.13@tcp:36:bash.0 Request processed in 569us (1999us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788535939.479097:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000020:00080000:1.0:1788535939.479101:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788535939.485098:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535939.485202:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548349056 00000100:00100000:0.0:1788535939.485213:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548349056 00000100:00100000:0.0:1788535939.485281:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:0.0:1788535939.485291:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+29:10860:x1875415548349056:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788535939.485313:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535939.485334:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcb57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165545f expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.485393:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcb57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165545f expref: 30 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.485409:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcb57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165545f expref: 30 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.485428:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:0.0:1788535939.485431:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535939.485435:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454a00, rc 0) 00000100:00100000:0.0:1788535939.485496:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+30:10860:x1875415548349056:12345-192.168.203.13@tcp:101:bash.0 Request processed in 206us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535939.485503:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1788535939.492071:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535939.492192:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548349184 00000100:00100000:2.0:1788535939.492202:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548349184 00000100:00100000:2.0:1788535939.492343:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1788535939.492354:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:10860:x1875415548349184:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788535939.492372:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535939.492394:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655466 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788535939.492420:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ae480, atime: 0x6a9ae47e, ctime: 0x6a9ae480, blocks: 0x8 00010000:00010000:2.0:1788535939.492444:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1788535939.492449:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535939.492473:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655466 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.492495:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655466 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.492509:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e461e00, rc 0) 00000100:00100000:2.0:1788535939.492565:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:10860:x1875415548349184:12345-192.168.203.13@tcp:101:bash.0 Request processed in 214us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535939.492573:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00080000:0.0:1788535939.493474:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535939.495402:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535939.495719:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548349312 00000100:00100000:2.0:1788535939.495728:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548349312 00002000:00010000:2.0:1788535939.495766:0:8451:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788535939.495771:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fbfb800 with x1875415548349312 ext(0->18446744073709551615) 00002000:00010000:2.0:1788535939.495783:0:8451:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fbfb800. 00000100:00100000:2.0:1788535939.495813:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1788535939.495823:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2399:x1875415548349312:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:2.0:1788535939.496081:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788535939.496085:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788535936 -> 1788535939 00002000:00010000:2.0:1788535939.496088:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788535934 -> 1788535934 00002000:00010000:2.0:1788535939.496090:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788535936 -> 1788535939 00002000:00010000:2.0:1788535939.496092:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788535939.496180:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2399:x1875415548349312:12345-192.168.203.13@tcp:10:bash.0 Request processed in 358us (785us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788535939.496188:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00010000:2.0:1788535939.496192:0:8451:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788535939.496201:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fbfb800 with x1875415548349312 ext(0->18446744073709551615) 00002000:00010000:2.0:1788535939.496206:0:8451:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fbfb800. 00000100:00100000:0.0:1788535939.501935:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569401088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788535939.503404:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535939.504188:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569401088 00000100:00100000:2.0:1788535939.504198:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569401088 00000100:00100000:2.0:1788535939.504253:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788535939.504262:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569401088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788535939.504300:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788535939.504364:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569401088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535939.504371:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788535939.504659:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569401088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535939.583795:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535939.583911:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548349440 00000100:00100000:2.0:1788535939.583921:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548349440 00000100:00100000:2.0:1788535939.583983:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:2.0:1788535939.583993:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+30:11355:x1875415548349440:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788535939.584064:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584081:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584093:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584107:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584113:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584119:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584254:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584265:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584272:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535939.584315:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584326:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584333:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584340:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584347:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535939.584352:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584359:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584370:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:2.0:1788535939.584373:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535939.584378:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584391:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcb65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584405:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584411:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584416:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584420:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535939.584423:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584429:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584436:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900583bb4400) 00010000:00010000:2.0:1788535939.584438:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535939.584441:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584447:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcb6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584461:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584466:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584478:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584482:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535939.584484:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584490:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584497:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:2.0:1788535939.584499:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535939.584501:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535939.584507:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcb73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535939.584663:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+30:11355:x1875415548349440:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 669us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535939.584670:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:3.0:1788535939.637651:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.637793:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548349696 00000100:00100000:1.0:1788535939.637803:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548349696 00000100:00100000:1.0:1788535939.637882:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:1.0:1788535939.637894:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+30:11359:x1875415548349696:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535939.637916:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535939.637939:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165546d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638412:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638428:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638439:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638453:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638460:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638466:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638574:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcb8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638585:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcb8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638592:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcb8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535939.638603:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788535939.638773:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638782:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638797:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638803:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535939.638808:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.638817:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.639142:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:1.0:1788535939.640142:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535939.640214:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640224:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcb81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640242:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640249:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640254:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640319:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535939.640323:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640347:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640360:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90059d464400) 00010000:00010000:1.0:1788535939.640363:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535939.640366:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640372:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcb88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640430:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165546d expref: 33 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640444:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcb8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165546d expref: 32 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.640451:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:1.0:1788535939.640453:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788535939.640456:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fa00, rc 0) 00000100:00100000:1.0:1788535939.640566:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+32:11359:x1875415548349696:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2674us (2928us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788535939.640575:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:3.0:1788535939.652101:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.652371:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548349824 00000100:00100000:1.0:1788535939.652382:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548349824 00000100:00100000:1.0:1788535939.652446:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:1.0:1788535939.652456:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+32:11359:x1875415548349824:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1788535939.652537:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.652554:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655451 expref: 32 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.652564:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.652596:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655451 expref: 32 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.652612:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655451 expref: 32 pid: 10112 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535939.652626:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569401216:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535939.652732:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535939.661617:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535939.661953:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548350080 00000100:00100000:2.0:1788535939.661963:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548350080 00000100:00100000:2.0:1788535939.662021:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788535939.662031:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+33:6169:x1875415548350080:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788535939.662360:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+34:6169:x1875415548350080:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 329us (752us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788535939.662369:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1788535939.664205:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569401216:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535939.664238:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535939.669219:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.669485:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548350208 00000100:00100000:1.0:1788535939.669495:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548350208 00010000:00010000:1.0:1788535939.669539:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655451 expref: 34 pid: 10112 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535939.669586:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1788535939.669597:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+34:2402:x1875415548350208:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535939.669626:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535939.669634:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655451 expref: 34 pid: 10112 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.669647:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655451 expref: 34 pid: 10112 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.669670:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcb34 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655451 expref: 34 pid: 10112 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.669704:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:1.0:1788535939.669710:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.669731:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.669740:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.669774:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535939.670733:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+33:2402:x1875415548350208:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1131us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535939.670747:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00010000:00010000:3.0:1788535939.670860:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.670877:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.670914:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.670921:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.670938:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.670959:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535939.670963:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.670971:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.670984:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:3.0:1788535939.670987:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535939.670990:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.670997:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcb9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535939.671047:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+32:11359:x1875415548349824:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 18593us (18957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535939.671054:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:3.0:1788535939.675479:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535939.675625:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548350464 00000100:00100000:2.0:1788535939.675634:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548350464 00000100:00100000:2.0:1788535939.675748:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788535939.675759:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+32:11359:x1875415548350464:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788535939.675993:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+33:11359:x1875415548350464:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 235us (524us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788535939.676001:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788535939.747435:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535939.747562:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548350720 00000100:00100000:0.0:1788535939.747571:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548350720 00000100:00100000:0.0:1788535939.747677:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:0.0:1788535939.747697:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+33:11370:x1875415548350720:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1788535939.747736:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535939.747759:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcba4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655474 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.748558:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.748575:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.748586:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.748601:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.748608:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.748615:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.748744:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdcbb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.748769:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdcbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.748777:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdcbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535939.748787:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788535939.749314:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749324:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749331:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749338:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535939.749342:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749351:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749364:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535939.749367:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535939.749371:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749378:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcbab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749391:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749406:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749412:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749417:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535939.749420:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749426:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749433:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9005893b0500) 00010000:00010000:0.0:1788535939.749436:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535939.749439:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749445:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcbb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749487:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcba4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655474 expref: 36 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749502:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdcbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655474 expref: 35 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535939.749508:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:0.0:1788535939.749511:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535939.749519:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455400, rc 0) 00000100:00100000:0.0:1788535939.749591:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+35:11370:x1875415548350720:12345-192.168.203.13@tcp:101:cat.0 Request processed in 1903us (2915us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788535939.749599:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:3.0:1788535939.762481:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535939.762801:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548350976 00000100:00100000:0.0:1788535939.762811:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548350976 00000100:00100000:0.0:1788535939.762883:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1788535939.762901:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+35:11370:x1875415548350976:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:0.0:1788535939.763201:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+36:11370:x1875415548350976:12345-192.168.203.13@tcp:35:cat.0 Request processed in 308us (727us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788535939.763209:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1788535939.781725:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.781839:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548351232 00000100:00100000:1.0:1788535939.781850:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548351232 00000100:00100000:1.0:1788535939.782238:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:1.0:1788535939.782249:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+36:11371:x1875415548351232:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:1.0:1788535939.782327:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788535939.782355:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcb57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165545f expref: 36 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782378:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdcbb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655474 expref: 35 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782391:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcb8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165546d expref: 34 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782404:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcb49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655458 expref: 33 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782415:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:1.0:1788535939.782420:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535939.782446:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782461:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782473:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782487:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782493:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782509:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782588:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782598:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.782604:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788535939.782807:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788535939.782816:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398586668967ns, next at 399586666807ns, rc = 0 00010000:00010000:1.0:1788535939.782859:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783559:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783569:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783578:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783587:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783595:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783638:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788535939.783660:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783666:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783671:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783677:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535939.783681:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783689:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783699:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:1.0:1788535939.783702:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788535939.783706:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783721:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcbd5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783741:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783748:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783753:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783764:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535939.783767:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783773:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783781:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:1.0:1788535939.783784:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535939.783787:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783792:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcbc7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535939.783803:0:6533:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000ce62655a reply state 000000008392f32f transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783813:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.783818:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90059d464400) 00010000:00010000:1.0:1788535939.783821:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788535939.783823:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535939.784405:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+34:11371:x1875415548351232:12345-192.168.203.13@tcp:36:rm.0 Request processed in 2153us (2693us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788535939.784414:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00010000:00010000:3.0:1788535939.784480:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535939.784486:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.784494:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620ec00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:3.0:1788535939.784504:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.784510:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.784521:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:3.0:1788535939.784523:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788535939.784526:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.784531:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcbdc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.784542:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535939.784544:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535939.784545:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535939.834116:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535939.834446:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548351488 00000100:00100000:3.0:1788535939.834456:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548351488 00000100:00100000:3.0:1788535939.834519:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:3.0:1788535939.834531:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+34:11377:x1875415548351488:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788535939.834554:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535939.834575:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcbe3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165547b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.834684:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.834700:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.834719:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.834748:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.834757:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.834764:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535939.835123:0:6535:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788535939.835309:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835320:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835327:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835360:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835367:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835374:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835380:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535939.835384:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835402:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835414:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:3.0:1788535939.835418:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535939.835422:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835428:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcbea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535939.835441:0:6535:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000a8bab0b9 reply state 000000008d3a140d transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835452:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835457:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90059d464400) 00010000:00010000:3.0:1788535939.835460:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535939.835463:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788535939.835491:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcbe3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165547b expref: 37 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835507:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165547b expref: 36 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535939.835514:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff900486936a00) 00010000:00010000:3.0:1788535939.835516:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535939.835518:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50400, rc 0) 00000100:00100000:3.0:1788535939.835591:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+37:11377:x1875415548351488:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1062us (1487us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788535939.835605:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:0.0:1788535939.842672:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.843055:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548351616 00000100:00100000:1.0:1788535939.843064:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548351616 00000100:00100000:1.0:1788535939.843207:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1788535939.843218:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005c191ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2400:x1875415548351616:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535939.843236:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535939.843307:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655482 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788535939.843335:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788535939.843357:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:1.0:1788535939.843362:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535939.843372:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655482 expref: 8 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.843392:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655482 expref: 8 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.843406:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fe00, rc 0) 00000100:00100000:1.0:1788535939.843514:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005c191ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2400:x1875415548351616:12345-192.168.203.13@tcp:101:bash.0 Request processed in 297us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535939.843522:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00080000:0.0:1788535939.843804:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535939.847124:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.847249:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548351744 00000100:00100000:1.0:1788535939.847258:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548351744 00000100:00100000:1.0:1788535939.847357:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1788535939.847367:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+8:11377:x1875415548351744:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535939.847385:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535939.847402:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655489 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.847451:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655482 expref: 9 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.847461:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535939.847465:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535939.847470:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.847504:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655482 expref: 9 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.847517:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655482 expref: 9 pid: 8448 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535939.847531:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1875415569401344:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535939.847617:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535939.849849:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8447:1875415569401344:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535939.849886:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.849924:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f600, rc 0) 00000100:00100000:1.0:1788535939.849985:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:11377:x1875415548351744:12345-192.168.203.13@tcp:101:bash.0 Request processed in 2618us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535939.849993:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1788535939.852593:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.852668:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548351872 00000100:00100000:1.0:1788535939.852677:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548351872 00010000:00010000:1.0:1788535939.852740:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655482 expref: 9 pid: 8448 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535939.852792:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1788535939.852803:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2401:x1875415548351872:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535939.852819:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535939.852839:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655482 expref: 9 pid: 8448 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.852853:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655482 expref: 9 pid: 8448 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.852883:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdcc06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655482 expref: 9 pid: 8448 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.853114:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535939.853120:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535939.853130:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.853141:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.853222:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535939.853251:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6520:1875415569401472:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788535939.853425:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535939.857585:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6520:1875415569401472:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788535939.857613:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535939.857666:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548351872:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4864us (5081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535939.857677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1788535939.862575:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535939.862668:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548352128 00000100:00100000:0.0:1788535939.862677:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548352128 00000100:00100000:0.0:1788535939.862742:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1788535939.862752:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+37:11377:x1875415548352128:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1788535939.863084:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+38:11377:x1875415548352128:12345-192.168.203.13@tcp:35:bash.0 Request processed in 333us (519us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788535939.863093:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1788535939.967071:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535939.967143:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535939.967235:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535939.967258:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.967459:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548352512 00000100:00100000:1.0:1788535939.967470:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548352512 00000100:00100000:1.0:1788535939.967537:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548352384 00000100:00100000:1.0:1788535939.967541:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548352384 00000100:00100000:1.0:1788535939.967560:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548352640 00000100:00100000:1.0:1788535939.967563:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548352640 00000100:00100000:1.0:1788535939.967582:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 267 00000100:00100000:1.0:1788535939.967592:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548352512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535939.967663:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548352512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535939.967670:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 267 00000100:00100000:1.0:1788535939.967688:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:1.0:1788535939.967694:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548352384:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535939.967731:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2401:x1875415548352384:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 36us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535939.967738:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:1.0:1788535939.967750:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00100000:1.0:1788535939.967771:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548352640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535939.967795:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548352640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535939.967801:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00080000:0.0:1788535939.967869:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788535939.967873:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535939.968185:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548352256 00000100:00100000:2.0:1788535939.968190:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548352256 00000100:00100000:2.0:1788535939.968218:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 377 00000100:00100000:2.0:1788535939.968224:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548352256:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535939.968251:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2401:x1875415548352256:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535939.968257:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 377 00000100:00100000:3.0:1788535939.995668:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535939.995784:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548352768 00000100:00100000:1.0:1788535939.995793:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548352768 00000100:00100000:1.0:1788535939.995856:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:1.0:1788535939.995866:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+38:11393:x1875415548352768:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535939.995889:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535939.995908:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcc14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655490 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.995992:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcc1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.996007:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcc1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.996019:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcc1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535939.996059:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788535939.996064:0:10016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535939.996082:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcc1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.996106:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcc14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655490 expref: 40 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.996137:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcc1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655490 expref: 39 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535939.996245:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:1.0:1788535939.996250:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535939.996254:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fa00, rc 0) 00000100:00100000:1.0:1788535939.996315:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+39:11393:x1875415548352768:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 450us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535939.996322:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:2.0:1788535940.000025:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.000240:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548353024 00000100:00100000:0.0:1788535940.000250:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548353024 00000100:00100000:0.0:1788535940.000308:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:0.0:1788535940.000318:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+39:11393:x1875415548353024:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535940.000337:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535940.000375:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcc22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655497 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.000483:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcc29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.000498:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcc29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.000510:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcc29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535940.000523:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788535940.000624:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcc22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655497 expref: 42 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.000643:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcc29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655497 expref: 41 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.000651:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff900486936a00) 00010000:00010000:0.0:1788535940.000654:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535940.000658:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455200, rc 0) 00000100:00100000:0.0:1788535940.000818:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+41:11393:x1875415548353024:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 500us (800us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788535940.000834:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:0.0:1788535940.010380:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.010434:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.010513:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548353408 00000100:00100000:2.0:1788535940.010523:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548353408 00000100:00100000:2.0:1788535940.010599:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788535940.010609:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+41:2401:x1875415548353408:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535940.010625:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535940.010650:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcc29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655497 expref: 41 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.010689:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff900486936a00) 00010000:00010000:2.0:1788535940.010695:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535940.010756:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+40:2401:x1875415548353408:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 147us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.010764:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1788535940.012003:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548353280 00000100:00100000:3.0:1788535940.012013:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548353280 00000100:00100000:3.0:1788535940.012069:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:3.0:1788535940.012078:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+40:11393:x1875415548353280:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535940.012096:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.012112:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcc37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165549e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.012241:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcc3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.012254:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcc3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.012266:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcc3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535940.012278:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788535940.012382:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcc37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165549e expref: 43 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.012421:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcc3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165549e expref: 42 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.012430:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff900486936a00) 00010000:00010000:3.0:1788535940.012432:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788535940.012435:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50800, rc 0) 00000100:00100000:3.0:1788535940.012486:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+42:11393:x1875415548353280:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 410us (2052us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1788535940.012492:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000001:00080000:1.0:1788535940.016796:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788535940.016825:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1788535940.020355:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.020458:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548353536 00000100:00100000:3.0:1788535940.020468:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548353536 00000100:00100000:3.0:1788535940.020525:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788535940.020535:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2399:x1875415548353536:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:3.0:1788535940.020583:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.020602:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.020609:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535940.020613:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535940.020618:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.020651:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.020678:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 6 pid: 8447 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.020693:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1875415569401600:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535940.020798:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a179c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535940.023214:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.023377:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548353664 00000100:00100000:0.0:1788535940.023385:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548353664 00002000:00100000:0.0:1788535940.023443:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff900488820a80 x1875415548353664/t0(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:596/0 lens 504/0 e 0 to 0 dl 1788535951 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535940.023455:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff900488820a80 with x1875415548353664 ext(0->8) 00010000:00010000:0.0:1788535940.023465:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 7 pid: 8447 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.023481:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 7 pid: 8447 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535940.023488:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff900488820a80 00000100:00100000:0.0:1788535940.023522:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1788535940.023532:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2401:x1875415548353664:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:3.0:1788535940.024261:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1875415569401600:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535940.024288:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.025698:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2401:x1875415548353664:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 2160us (2486us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788535940.025719:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00100000:0.0:1788535940.025730:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff900488820a80 x1875415548353664/t4294967303(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:596/0 lens 504/448 e 0 to 0 dl 1788535951 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535940.025741:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff900488820a80 with x1875415548353664 ext(0->8) 00010000:00010000:0.0:1788535940.025750:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 9 pid: 8447 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.025767:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 9 pid: 8447 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535940.025785:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff900488820a80 00000100:00100000:0.0:1788535940.028654:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.028745:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548353792 00000100:00100000:2.0:1788535940.028755:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548353792 00010000:00010000:2.0:1788535940.028808:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 9 pid: 8447 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.028992:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:2.0:1788535940.029003:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfa9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2400:x1875415548353792:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535940.029019:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788535940.029038:0:6519:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788535940.029041:0:6519:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788535940 00002000:00010000:2.0:1788535940.029043:0:6519:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788535940 00002000:00010000:2.0:1788535940.029046:0:6519:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788535940 00002000:00010000:2.0:1788535940.029048:0:6519:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788535940.029054:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 9 pid: 8447 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.029069:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 9 pid: 8447 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.029111:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050ef086e/0xe79af2f39bbdcc0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655489 expref: 9 pid: 8447 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.029129:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788535940.029133:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788535940.029139:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.029196:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.029228:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535940.029279:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfa9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2400:x1875415548353792:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 277us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.029287:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00010000:00010000:3.0:1788535940.030473:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.030488:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.030514:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.030521:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.030529:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.030553:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:3.0:1788535940.030557:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.030565:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.030581:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.030590:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcc4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.030671:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2399:x1875415548353536:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 10135us (10325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.030680:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1788535940.032552:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.032611:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548354048 00000100:00100000:2.0:1788535940.032620:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548354048 00000100:00100000:2.0:1788535940.032668:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1788535940.032676:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf15c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+42:11393:x1875415548354048:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:2.0:1788535940.032741:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcc3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165549e expref: 42 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535940.033206:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788535940.033232:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1788535940.033505:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:2.0:1788535940.033537:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.033556:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165547b expref: 46 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.033565:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.033597:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165547b expref: 46 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.033610:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165547b expref: 46 pid: 6535 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.033625:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488823100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875415569401728:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535940.033695:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.036181:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.036283:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548354176 00000100:00100000:1.0:1788535940.036291:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548354176 00010000:00010000:1.0:1788535940.036327:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165547b expref: 47 pid: 6535 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.036366:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1788535940.036376:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+47:2402:x1875415548354176:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535940.036388:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535940.036394:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165547b expref: 47 pid: 6535 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.036407:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165547b expref: 47 pid: 6535 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.036428:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff900486936a00) 00010000:00010000:1.0:1788535940.036447:0:10351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.036457:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.036465:0:10351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.036484:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535940.036541:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+47:2402:x1875415548354176:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 166us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.036549:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00010000:00010000:2.0:1788535940.037631:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcbf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165547b expref: 46 pid: 6535 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.037649:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488823100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875415569401728:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535940.037669:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.037678:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.037685:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535940.037799:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:2.0:1788535940.038092:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788535940.038262:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488823100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875415569401856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788535940.038317:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535940.038383:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105000 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.038604:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569401856 00000100:00100000:0.0:1788535940.038610:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569401856 00000100:00100000:0.0:1788535940.038689:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788535940.038698:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875415569401856:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788535940.038796:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875415569401856:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 99us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.038802:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788535940.038995:0:6537:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1788535940.039001:0:6537:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1788535940.039016:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff900488397100, transno 4294967302 00000100:00100000:1.0:1788535940.039036:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488823100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875415569401856:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788535940.039138:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:1.0:1788535940.039207:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875415569401984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788535940.039237:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535940.039251:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535940.039363:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569401984 00000100:00100000:3.0:1788535940.039368:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569401984 00000100:00100000:3.0:1788535940.039389:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788535940.039395:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875415569401984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788535940.039495:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6537:x1875415569401984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 99us (257us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788535940.039502:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788535940.039659:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875415569401984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788535940.039693:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788535940.040805:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.041418:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.041449:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.041456:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.041461:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.041469:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.041484:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff900486936a00) 00010000:00010000:1.0:1788535940.041488:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788535940.041492:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.041498:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc53 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788535940.041621:0:6537:0:(mdd_object.c:4338:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788535940.041761:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788535940.041834:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398845686130ns, next at 399845622780ns, rc = 0 00000001:00080000:1.0:1788535940.041845:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:1.0:1788535940.042030:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff900486936a00) 00010000:00010000:1.0:1788535940.042034:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788535940.042042:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcc3e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165549e expref: 50 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.042485:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf15c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+49:11393:x1875415548354048:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 9807us (9938us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788535940.042507:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000020:00080000:1.0:1788535940.042512:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1788535940.042736:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535940.046447:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.046520:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548354304 00000100:00100000:2.0:1788535940.046531:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548354304 00000100:00100000:2.0:1788535940.046592:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:2.0:1788535940.046602:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+49:11393:x1875415548354304:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788535940.046626:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535940.046660:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcc5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.046726:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcc5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554a5 expref: 50 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.046741:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcc5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554a5 expref: 50 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.046759:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535940.046762:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535940.046765:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460a00, rc 0) 00000100:00100000:2.0:1788535940.046840:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+50:11393:x1875415548354304:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 239us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.046848:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:0.0:1788535940.050388:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.050471:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548354560 00000100:00100000:2.0:1788535940.050481:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548354560 00000100:00100000:2.0:1788535940.050538:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1788535940.050563:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+50:11393:x1875415548354560:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788535940.050814:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+51:11393:x1875415548354560:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 252us (436us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788535940.051033:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788535940.129633:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.129738:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548354688 00000100:00100000:2.0:1788535940.129747:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548354688 00000100:00100000:2.0:1788535940.129828:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:2.0:1788535940.129839:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+51:11403:x1875415548354688:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788535940.130190:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.130208:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.130220:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.130231:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.130238:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.130244:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.130339:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.130347:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131003:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535940.131056:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131071:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131078:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131085:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131091:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535940.131095:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131102:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131114:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:2.0:1788535940.131117:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535940.131121:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131127:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdcc61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131141:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131201:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131206:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131211:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535940.131214:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131220:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131227:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90059d464400) 00010000:00010000:2.0:1788535940.131230:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535940.131232:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131238:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcc68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131247:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131253:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131258:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131262:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535940.131270:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131276:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131283:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535940.131285:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535940.131288:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.131294:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcc6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.132475:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+51:11403:x1875415548354688:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 2629us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.132486:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:0.0:1788535940.182964:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.183564:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548354944 00000100:00100000:1.0:1788535940.183575:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548354944 00000100:00100000:1.0:1788535940.183694:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:1.0:1788535940.183705:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+51:11406:x1875415548354944:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535940.183735:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.183754:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcc76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554ac expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.183825:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.183840:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.183851:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.183863:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.183871:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.183877:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.183976:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184001:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184009:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535940.184020:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788535940.184095:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184103:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184110:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184115:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.184119:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184126:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184139:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:1.0:1788535940.184142:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.184176:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184183:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcc7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184196:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184209:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184215:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184220:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.184224:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184230:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184239:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90059d464400) 00010000:00010000:1.0:1788535940.184241:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.184244:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184250:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcc84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184286:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcc76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ac expref: 54 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184299:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ac expref: 53 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.184308:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:1.0:1788535940.184310:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535940.184320:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e800, rc 0) 00000100:00100000:1.0:1788535940.184379:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+53:11406:x1875415548354944:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 675us (1423us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788535940.184386:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:0.0:1788535940.191330:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.191411:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548355072 00000100:00100000:3.0:1788535940.191420:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548355072 00000100:00100000:3.0:1788535940.191492:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1788535940.191502:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+53:11406:x1875415548355072:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1788535940.191566:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.191582:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.191593:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.191625:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.191633:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.191639:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.191645:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535940.191655:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.191663:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.191674:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:3.0:1788535940.191677:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535940.191682:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.191699:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcc99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.191779:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+53:11406:x1875415548355072:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 278us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.191787:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:0.0:1788535940.194254:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.194440:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548355328 00000100:00100000:3.0:1788535940.194450:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548355328 00000100:00100000:3.0:1788535940.194504:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1788535940.194514:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+53:11406:x1875415548355328:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788535940.194723:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+54:11406:x1875415548355328:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 210us (476us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788535940.194730:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:0.0:1788535940.267536:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.267698:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548355584 00000100:00100000:2.0:1788535940.267719:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548355584 00000100:00100000:2.0:1788535940.267791:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:2.0:1788535940.267804:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+54:11416:x1875415548355584:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788535940.267830:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535940.267834:0:10112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788535940.267875:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcc1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655490 expref: 54 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.267896:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:2.0:1788535940.267902:0:10112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535940.267924:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcca0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554b3 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.268050:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.268063:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ac expref: 54 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.268072:0:10112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.268106:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ac expref: 54 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.268119:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ac expref: 54 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.268132:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488822300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569402112:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535940.268285:0:10112:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788535940.268894:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535940.273956:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488822300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569402112:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535940.273985:0:10112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.279467:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.280363:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548355712 00000100:00100000:2.0:1788535940.280376:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548355712 00010000:00010000:2.0:1788535940.280431:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ac expref: 55 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.280472:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1788535940.280496:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+55:2401:x1875415548355712:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535940.280511:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535940.280518:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ac expref: 55 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.280532:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ac expref: 55 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.280552:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcc8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ac expref: 55 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.281106:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535940.281113:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.281124:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.281131:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.281237:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535940.281303:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+54:2401:x1875415548355712:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 807us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.281312:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00010000:00010000:0.0:1788535940.281573:0:10112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.281582:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535940.281600:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788535940.281737:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdcca0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554b3 expref: 55 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.281788:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554b3 expref: 54 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.281806:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:0.0:1788535940.281809:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788535940.281812:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e460800, rc 0) 00000100:00100000:0.0:1788535940.281850:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+54:11416:x1875415548355584:12345-192.168.203.13@tcp:101:bash.0 Request processed in 14049us (14323us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788535940.281857:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:0.0:1788535940.287417:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.287495:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548355840 00000100:00100000:1.0:1788535940.287505:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548355840 00000100:00100000:1.0:1788535940.287561:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1788535940.287583:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+54:11416:x1875415548355840:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535940.287607:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.287628:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdccb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554ba expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.287664:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.287684:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.287696:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.287838:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdccb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ba expref: 56 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.287858:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ba expref: 55 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.287866:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:1.0:1788535940.287869:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788535940.287880:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f800, rc 0) 00000100:00100000:1.0:1788535940.288015:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+55:11416:x1875415548355840:12345-192.168.203.13@tcp:101:bash.0 Request processed in 434us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.288023:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:3.0:1788535940.293966:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.294339:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548356096 00000100:00100000:2.0:1788535940.294349:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548356096 00000100:00100000:2.0:1788535940.294424:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:2.0:1788535940.294435:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+55:11416:x1875415548356096:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:2.0:1788535940.294742:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.294758:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.294769:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535940.294807:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:2.0:1788535940.295330:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000065aa7cda reply state 00000000f0bd47ac transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.295346:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.295353:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535940.295357:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788535940.295360:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535940.297322:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+58:11416:x1875415548356096:12345-192.168.203.13@tcp:36:bash.0 Request processed in 2879us (3357us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788535940.297334:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000020:00080000:3.0:1788535940.297341:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788535940.302865:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.303015:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548356224 00000100:00100000:2.0:1788535940.303026:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548356224 00000100:00100000:2.0:1788535940.303091:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1788535940.303102:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+58:11416:x1875415548356224:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788535940.303123:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535940.303143:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdccca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554c1 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.303273:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.303287:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554b3 expref: 59 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.303311:0:10112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.303344:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554b3 expref: 59 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.303358:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554b3 expref: 59 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.303372:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488822300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569402240:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535940.303528:0:10112:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.308125:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.308507:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488822300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569402240:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535940.308533:0:10112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.308669:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548356352 00000100:00100000:1.0:1788535940.308677:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548356352 00010000:00010000:1.0:1788535940.308725:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554b3 expref: 60 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.308761:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:1.0:1788535940.308770:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+60:2401:x1875415548356352:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535940.308785:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535940.309073:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554b3 expref: 60 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.309089:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554b3 expref: 60 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.309111:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460800/0xe79af2f39bbdcca7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554b3 expref: 60 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.309127:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:1.0:1788535940.309132:0:10351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.309141:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.309187:0:10351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.311288:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535940.311362:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+59:2401:x1875415548356352:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 2588us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.311372:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00010000:00010000:2.0:1788535940.311506:0:10112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.311516:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535940.312082:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788535940.312088:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788535940.312116:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.312177:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461200/0xe79af2f39bbdccca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c1 expref: 59 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.312226:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c1 expref: 58 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.312235:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535940.312238:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535940.312241:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3e200, rc 0) 00000100:00100000:2.0:1788535940.312279:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+58:11416:x1875415548356224:12345-192.168.203.13@tcp:101:bash.0 Request processed in 9179us (9425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.312286:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1788535940.320531:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.320850:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548356608 00000100:00100000:1.0:1788535940.320859:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548356608 00000100:00100000:1.0:1788535940.320911:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1788535940.320920:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+58:11416:x1875415548356608:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1788535940.321109:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+59:11416:x1875415548356608:12345-192.168.203.13@tcp:35:bash.0 Request processed in 190us (587us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788535940.321117:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1788535940.386669:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.386789:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548356736 00000100:00100000:1.0:1788535940.386808:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548356736 00000100:00100000:1.0:1788535940.386883:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1788535940.386893:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+59:11422:x1875415548356736:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535940.386922:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.386943:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdccd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554c8 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.387004:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdccdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.387017:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdccdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.387028:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdccdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535940.387087:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788535940.387091:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535940.387111:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdccdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.387135:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdccd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c8 expref: 61 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.387182:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdccdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c8 expref: 60 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.387191:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:1.0:1788535940.387194:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535940.387198:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e600, rc 0) 00000100:00100000:1.0:1788535940.387266:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+60:11422:x1875415548356736:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 374us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.387273:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:0.0:1788535940.395268:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.395609:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548356864 00000100:00100000:3.0:1788535940.395620:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548356864 00000100:00100000:3.0:1788535940.395684:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1788535940.395695:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005894aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+60:11422:x1875415548356864:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535940.395728:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.395750:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcce6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554cf expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.395829:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.395843:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.395853:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.395876:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.395883:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.396291:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.396365:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.396374:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.396521:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535940.396828:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788535940.396832:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788535940.396851:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397001:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397010:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397017:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397024:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397029:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535940.397033:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397041:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397052:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:3.0:1788535940.397055:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.397059:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397065:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcced lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397078:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397083:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397096:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397100:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535940.397103:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397109:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397117:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90059d464400) 00010000:00010000:3.0:1788535940.397120:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535940.397122:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397128:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdccf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397239:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcce6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 62 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397255:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.397263:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:3.0:1788535940.397265:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535940.397268:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50800, rc 0) 00000100:00100000:3.0:1788535940.397338:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005894aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11422:x1875415548356864:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1643us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.397355:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:0.0:1788535940.401344:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.401442:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548357120 00000100:00100000:2.0:1788535940.401451:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548357120 00000100:00100000:2.0:1788535940.401512:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:2.0:1788535940.401523:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11422:x1875415548357120:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788535940.401541:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535940.401589:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcd02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554d6 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.401689:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.401703:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c1 expref: 62 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.401723:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 62 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.401744:0:10112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.402086:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 62 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.402101:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 62 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.402114:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488822300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569402368:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535940.402263:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c1 expref: 62 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.402273:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c1 expref: 62 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.402282:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488820700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569402496:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535940.402308:0:10112:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788535940.416261:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.417183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548357248 00000100:00100000:3.0:1788535940.417196:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548357248 00010000:00010000:3.0:1788535940.417240:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 63 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.417287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:3.0:1788535940.417297:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+63:2401:x1875415548357248:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535940.417311:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535940.417317:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 63 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.417329:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 63 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.417351:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:3.0:1788535940.417356:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.417364:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.417370:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535940.417445:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+63:2401:x1875415548357248:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 149us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.417452:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:3.0:1788535940.421870:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.422344:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548357376 00000100:00100000:0.0:1788535940.422355:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548357376 00010000:00010000:0.0:1788535940.422412:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c1 expref: 63 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.422456:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1788535940.422467:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+63:2402:x1875415548357376:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535940.422482:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535940.422489:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c1 expref: 63 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.422517:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c1 expref: 63 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.422543:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:0.0:1788535940.422550:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.422561:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.422570:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.422591:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535940.422661:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+63:2402:x1875415548357376:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 196us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.422670:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00010000:00010000:2.0:1788535940.422866:0:10112:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.13@tcp) returned -22 from blocking AST (req@0000000058e25bd0 x1875415569402368) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 62 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.422882:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdccfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554cf expref: 62 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.422898:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488822300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569402368:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535940.422920:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e200/0xe79af2f39bbdccd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c1 expref: 61 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.422933:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488820700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569402496:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535940.422954:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535940.422960:0:10112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.422969:0:10112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.422976:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535940.422996:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788535940.423143:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcd02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554d6 expref: 62 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.423212:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554d6 expref: 61 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.423220:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535940.423223:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788535940.423226:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067e00, rc 0) 00000100:00100000:2.0:1788535940.423254:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11422:x1875415548357120:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 21733us (21919us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788535940.423261:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1788535940.426590:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.426667:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548357632 00000100:00100000:3.0:1788535940.426677:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548357632 00000100:00100000:3.0:1788535940.426789:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1788535940.426810:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11422:x1875415548357632:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:3.0:1788535940.426831:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535940.426855:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460a00/0xe79af2f39bbdcc5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554a5 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.426883:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:3.0:1788535940.426888:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535940.426953:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+60:11422:x1875415548357632:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.426960:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788535940.429316:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.429391:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548357760 00000100:00100000:1.0:1788535940.429407:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548357760 00000100:00100000:1.0:1788535940.429461:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1788535940.429470:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+60:11422:x1875415548357760:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:1.0:1788535940.429570:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.429586:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.429616:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788535940.429717:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788535940.429795:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+60:11422:x1875415548357760:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 326us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.429803:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:0.0:1788535940.431699:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.431783:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548357888 00000100:00100000:3.0:1788535940.431793:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548357888 00000100:00100000:3.0:1788535940.432260:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:3.0:1788535940.432272:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+60:11422:x1875415548357888:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535940.432291:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.432310:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554dd expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.432363:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.432374:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554dd expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.432761:0:6534:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.432803:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554dd expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.432817:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:3.0:1788535940.433088:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535940.433094:0:6534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554dd expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.433103:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50400, rc 0) 00000100:00100000:2.0:1788535940.433554:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11422:x1875415548357888:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1281us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.433570:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000040:00080000:1.0:1788535940.460353:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535940.460364:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535940.460417:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788535940.460428:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788535940.460692:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569402624:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788535940.460802:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535940.464240:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569402624:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788535940.467363:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.467601:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548358016 00000100:00100000:3.0:1788535940.467613:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548358016 00000100:00100000:3.0:1788535940.467677:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:3.0:1788535940.467687:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11423:x1875415548358016:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788535940.467730:0:10112:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788535940.468122:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11423:x1875415548358016:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 435us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.468131:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:0.0:1788535940.476625:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.476735:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548358144 00000100:00100000:1.0:1788535940.476745:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548358144 00000100:00100000:1.0:1788535940.477077:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:1.0:1788535940.477089:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11423:x1875415548358144:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788535940.477189:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477205:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477219:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477253:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477261:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477268:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477292:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477301:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477308:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535940.477353:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788535940.477358:0:10016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535940.477372:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477382:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477389:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477406:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477422:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.477426:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477434:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477447:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:1.0:1788535940.477449:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.477454:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477461:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcd25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477476:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477482:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477487:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477491:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.477494:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477499:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477643:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff90059d464300) 00010000:00010000:1.0:1788535940.477646:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.477649:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477655:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcd2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477670:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477676:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477682:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477686:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620fa00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.477688:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477694:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477702:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:1.0:1788535940.477715:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.477719:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.477725:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcd33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.477832:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11423:x1875415548358144:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 745us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.477840:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:2.0:1788535940.482231:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.491729:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548358400 00000100:00100000:0.0:1788535940.491747:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548358400 00000100:00100000:0.0:1788535940.491870:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:0.0:1788535940.491881:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+61:11423:x1875415548358400:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535940.491900:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535940.491933:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcd3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554e4 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.492034:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.492049:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.492061:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535940.492072:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788535940.493770:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.493784:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.493791:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.493798:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535940.493802:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.493811:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.493825:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:0.0:1788535940.493829:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788535940.493834:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.493857:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcd41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.493907:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcd3a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554e4 expref: 63 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.493927:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:0.0:1788535940.493930:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535940.493934:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcd3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554e4 expref: 63 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.493944:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455a00, rc 0) 00000100:00100000:0.0:1788535940.494015:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+62:11423:x1875415548358400:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2135us (11792us total) trans 4294967400 rc 301/301 00000100:00100000:0.0:1788535940.494024:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:3.0:1788535940.498304:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.498414:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548358528 00000100:00100000:0.0:1788535940.498424:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548358528 00000100:00100000:0.0:1788535940.498481:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:0.0:1788535940.498492:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+62:11423:x1875415548358528:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788535940.498530:0:10112:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788535940.498657:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+62:11423:x1875415548358528:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 167us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.498665:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:2.0:1788535940.503034:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.503112:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548358784 00000100:00100000:0.0:1788535940.503122:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548358784 00000100:00100000:0.0:1788535940.503718:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:0.0:1788535940.503747:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+62:11423:x1875415548358784:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535940.503768:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535940.503771:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788535940.503797:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdccdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554c8 expref: 62 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.503817:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535940.503832:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535940.503846:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd4f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554eb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788535940.504242:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788535940.504759:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcd56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.504773:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcd56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.504784:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcd56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.504899:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd4f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554eb expref: 64 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.504917:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcd56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554eb expref: 63 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.504925:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9005893b0500) 00010000:00010000:0.0:1788535940.504928:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535940.504941:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455a00, rc 0) 00000100:00100000:0.0:1788535940.504997:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+63:11423:x1875415548358784:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1254us (1973us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788535940.505007:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:3.0:1788535940.507994:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.508122:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548359040 00000100:00100000:2.0:1788535940.508131:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548359040 00000100:00100000:2.0:1788535940.508216:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:2.0:1788535940.508227:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+63:11423:x1875415548359040:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788535940.508280:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535940.508305:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdcd56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554eb expref: 63 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508322:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9005893b0500) 00010000:00010000:2.0:1788535940.508333:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535940.508355:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508368:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508387:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508447:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508454:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508461:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508515:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508523:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508528:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508534:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535940.508538:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508546:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508555:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:2.0:1788535940.508557:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535940.508561:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508806:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdcd64 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508826:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508833:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508838:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508850:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535940.508854:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508859:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508868:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x5956fef6 (ffff90058febac00) 00010000:00010000:2.0:1788535940.508871:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535940.508874:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.508880:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdcd6b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x5956fef6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.508958:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+62:11423:x1875415548359040:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 732us (971us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788535940.508966:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:0.0:1788535940.514872:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.515041:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548359168 00000100:00100000:3.0:1788535940.515050:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548359168 00000100:00100000:3.0:1788535940.515117:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:3.0:1788535940.515129:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005842e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+62:11423:x1875415548359168:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535940.515186:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.515490:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcd72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554f2 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.515546:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.515572:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.515585:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.515691:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcd72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f2 expref: 64 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.515727:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f2 expref: 63 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.515737:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:3.0:1788535940.515740:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788535940.515744:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51400, rc 0) 00000100:00100000:3.0:1788535940.515846:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005842e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+63:11423:x1875415548359168:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 719us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.515853:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:0.0:1788535940.526667:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.527205:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548359424 00000100:00100000:3.0:1788535940.527216:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548359424 00000100:00100000:3.0:1788535940.527321:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:3.0:1788535940.527333:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+63:11423:x1875415548359424:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788535940.527411:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.527445:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.527458:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788535940.527686:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1788535940.527752:0:6533:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000051706c46 reply state 00000000e5aabf1c transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.527765:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.527991:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:3.0:1788535940.527995:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788535940.527999:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535940.528181:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+65:11423:x1875415548359424:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 849us (1522us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788535940.528189:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:2.0:1788535940.533213:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.533265:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548359552 00000100:00100000:3.0:1788535940.533276:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548359552 00000100:00100000:3.0:1788535940.533337:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:3.0:1788535940.533347:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+65:11423:x1875415548359552:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535940.533512:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535940.533535:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16554f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.533607:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f9 expref: 66 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.533623:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f9 expref: 66 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.533641:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:0.0:1788535940.533644:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535940.533647:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454600, rc 0) 00000100:00100000:0.0:1788535940.533703:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+66:11423:x1875415548359552:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 358us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.533721:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:1.0:1788535940.536671:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.537130:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548359680 00000100:00100000:0.0:1788535940.537140:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548359680 00000100:00100000:0.0:1788535940.537241:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1788535940.537251:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2399:x1875415548359680:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788535940.537464:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2399:x1875415548359680:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 214us (801us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788535940.537485:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1788535940.542753:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.544226:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548359936 00000100:00100000:1.0:1788535940.544239:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548359936 00000100:00100000:1.0:1788535940.544303:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1788535940.544314:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+66:11423:x1875415548359936:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788535940.544543:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+67:11423:x1875415548359936:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 231us (1799us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788535940.544551:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1788535940.547443:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.547584:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548360192 00000100:00100000:3.0:1788535940.547594:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548360192 00000100:00100000:3.0:1788535940.547651:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:3.0:1788535940.547667:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+67:11423:x1875415548360192:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788535940.547780:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+67:11423:x1875415548360192:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 120us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.547802:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:3.0:1788535940.550096:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.550186:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548360320 00000100:00100000:0.0:1788535940.550196:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548360320 00000100:00100000:0.0:1788535940.550262:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:0.0:1788535940.550272:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+67:11423:x1875415548360320:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535940.550290:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535940.550309:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdcd8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655500 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.550512:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcd95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.550526:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcd95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.550536:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcd95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535940.550577:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535940.550596:0:6533:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcd95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.550620:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdcd8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655500 expref: 69 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.550639:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcd95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655500 expref: 68 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.550648:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:0.0:1788535940.550658:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788535940.550662:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454a00, rc 0) 00000100:00100000:0.0:1788535940.550731:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+68:11423:x1875415548360320:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 460us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.550738:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:2.0:1788535940.554663:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.554752:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548360448 00000100:00100000:3.0:1788535940.554762:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548360448 00000100:00100000:3.0:1788535940.554818:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:3.0:1788535940.554829:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2399:x1875415548360448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535940.554845:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.554865:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655507 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788535940.554889:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae484, blocks: 0x0 00010000:00010000:3.0:1788535940.554907:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1788535940.554912:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535940.554921:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655507 expref: 10 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.554938:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655507 expref: 10 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.554951:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51200, rc 0) 00000100:00100000:3.0:1788535940.555104:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+10:2399:x1875415548360448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 276us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.555113:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1788535940.564248:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.564353:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548360704 00000100:00100000:2.0:1788535940.564363:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548360704 00000100:00100000:2.0:1788535940.564437:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:2.0:1788535940.564448:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+68:11423:x1875415548360704:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788535940.564560:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+68:11423:x1875415548360704:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 113us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.564582:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:0.0:1788535940.568401:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.568537:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548360832 00000100:00100000:1.0:1788535940.568546:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548360832 00000100:00100000:1.0:1788535940.568604:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1788535940.568614:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+10:11423:x1875415548360832:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535940.568630:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535940.568649:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165550e expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.568680:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655507 expref: 11 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.568689:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535940.568692:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535940.568698:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.568759:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655507 expref: 11 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.568773:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655507 expref: 11 pid: 8446 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.568788:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8447:1875415569402752:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535940.568878:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef540 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.577927:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.578042:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8447:1875415569402752:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535940.578077:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.578110:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e800, rc 0) 00000100:00100000:1.0:1788535940.578194:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+11:11423:x1875415548360832:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 9582us (9805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.578215:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1788535940.578554:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548360960 00000100:00100000:2.0:1788535940.578562:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548360960 00010000:00010000:2.0:1788535940.578599:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655507 expref: 11 pid: 8446 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.578636:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:2.0:1788535940.578646:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+11:2402:x1875415548360960:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535940.578660:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535940.578679:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655507 expref: 11 pid: 8446 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.578693:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655507 expref: 11 pid: 8446 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.578734:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb86e54e/0xe79af2f39bbdcd9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655507 expref: 11 pid: 8446 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.578748:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535940.578752:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535940.578762:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.578771:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.578825:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.578840:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6521:1875415569402880:192.168.203.13@tcp:105: 00000100:00100000:2.0:1788535940.578905:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105240 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.589489:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.589815:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548361088 00000100:00100000:2.0:1788535940.589826:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548361088 00002000:00100000:2.0:1788535940.589879:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90059fb07100 x1875415548361088/t0(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:596/0 lens 504/0 e 0 to 0 dl 1788535951 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535940.589891:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fb07100 with x1875415548361088 ext(0->12) 00002000:00010000:2.0:1788535940.589897:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fb07100 00000100:00100000:2.0:1788535940.589930:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1788535940.589941:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+11:2402:x1875415548361088:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788535940.590278:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6521:1875415569402880:192.168.203.13@tcp:105: 00010000:00010000:3.0:1788535940.590300:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535940.590353:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+11:2402:x1875415548360960:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 11708us (12436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.590362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:2.0:1788535940.591755:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+12:2402:x1875415548361088:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 1625us (2087us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788535940.591767:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:2.0:1788535940.591780:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90059fb07100 x1875415548361088/t4294967309(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:596/0 lens 504/448 e 0 to 0 dl 1788535951 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788535940.591789:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fb07100 with x1875415548361088 ext(0->12) 00002000:00010000:2.0:1788535940.591795:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fb07100 00000100:00100000:0.0:1788535940.596444:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.596777:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548361216 00000100:00100000:1.0:1788535940.596787:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548361216 00000100:00100000:1.0:1788535940.596845:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:1.0:1788535940.596855:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+68:11423:x1875415548361216:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788535940.602573:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:3.0:1788535940.602611:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788535940.602633:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9004876efa80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788535940.602639:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90058934b100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9004876ef9c0 00000020:00080000:3.0:1788535940.602642:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90058934ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff900487ad7800 00000004:00080000:3.0:1788535940.602670:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788535940.602699:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff900486ad0480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788535940.602703:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9005b7bb4b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff900486ad0780 00000020:00080000:3.0:1788535940.602717:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9005b7bb4d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9004879c5400 00000100:00100000:3.0:1788535940.602984:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569403008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788535940.603049:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535940.603170:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569403008 00000100:00100000:0.0:1788535940.603178:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569403008 00000100:00100000:0.0:1788535940.603239:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788535940.603248:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569403008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788535940.603273:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1788535940.603304:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ae484, atime: 0x6a9ae484, ctime: 0x6a9ae484, blocks: 0x8 00010000:00010000:0.0:1788535940.603313:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.603328:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1788535940.603332:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535940.603338:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.603354:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.603725:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.603735:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.603761:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788535940.603913:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3662:x1875415569403008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 665us (863us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788535940.603920:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:0.0:1788535940.603962:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90048816bb80/2, rc 0, transno 4294967305 00000100:00100000:0.0:1788535940.603968:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048816bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569403008:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788535940.604025:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535940.604032:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.604040:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455a00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:3.0:1788535940.604044:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.604054:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.604072:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.604090:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000983d14e9/0xe79af2f39bbdcdaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.604111:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535940.604113:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535940.604115:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535940.604519:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604528:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604541:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604546:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.604550:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604557:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604578:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9005893b0800) 00010000:00010000:1.0:1788535940.604581:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.604585:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604591:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdcaa8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604610:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604616:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604622:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604627:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.604629:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604646:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604655:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9005893b0c00) 00010000:00010000:1.0:1788535940.604658:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.604661:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604667:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcb50 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604684:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604690:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604696:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.604701:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.605367:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605449:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605462:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90059d464400) 00010000:00010000:1.0:1788535940.605465:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.605469:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605484:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcbce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605500:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605506:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605513:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605518:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.605521:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605526:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605535:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90059d464400) 00010000:00010000:1.0:1788535940.605537:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.605540:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605546:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcbf1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605680:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605689:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605701:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605718:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.605721:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605727:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605736:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:1.0:1788535940.605739:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.605742:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605748:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e461800/0xe79af2f39bbdccc3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605761:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605767:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605773:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605778:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.605781:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605798:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605807:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:1.0:1788535940.605809:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788535940.605812:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.605818:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcd80 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.605970:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11423:x1875415548361216:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 9112us (9532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.605979:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000020:00080000:2.0:1788535940.609791:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788535940.609875:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788535940.609967:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569403136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788535940.610042:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535940.610730:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569403136 00000100:00100000:1.0:1788535940.610741:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569403136 00000100:00100000:1.0:1788535940.610854:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788535940.610864:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3663:x1875415569403136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788535940.610892:0:10017:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1788535940.610917:0:10017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.610936:0:10017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655466 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.610945:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788535940.610949:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535940.610954:0:10017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.610995:0:10017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655466 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.611010:0:10017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655466 expref: 11 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.611024:0:10017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10017:1875415569403264:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535940.611234:0:10017:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef540 going to sleep for 11 seconds 00000100:00080000:2.0:1788535940.611657:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788535940.612058:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.612187:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548361344 00000100:00100000:3.0:1788535940.612194:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548361344 00000100:00100000:3.0:1788535940.612244:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:3.0:1788535940.612254:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+12:2401:x1875415548361344:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788535940.617949:0:10017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10017:1875415569403264:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535940.617982:0:10017:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.620895:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.620987:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548361472 00000100:00100000:1.0:1788535940.620995:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548361472 00010000:00010000:1.0:1788535940.621040:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655466 expref: 13 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.621095:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:1.0:1788535940.621105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+13:2401:x1875415548361472:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535940.621120:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535940.621126:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655466 expref: 13 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.621140:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655466 expref: 13 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.621188:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d14b78e0/0xe79af2f39bbdcb5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655466 expref: 13 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.621236:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535940.621240:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535940.621247:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.621257:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.621283:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535940.621338:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+12:2401:x1875415548361472:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 233us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.621346:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00010000:00010000:3.0:1788535940.621635:0:10017:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.621647:0:10017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.621657:0:10017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.621666:0:10017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.621697:0:10017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788535940.621885:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3663:x1875415569403136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11021us (11841us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788535940.621893:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1788535940.622020:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535940.622027:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.622035:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f600 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788535940.622040:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.622050:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.622066:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.622098:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdcdb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.622120:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535940.622122:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535940.622124:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788535940.622264:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90058ad6c700/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788535940.622283:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569403136:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788535940.625466:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788535940.625491:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:3.0:1788535940.632873:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548361344:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 20609us (20808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.632889:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788535940.640635:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.640742:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548361728 00000100:00100000:1.0:1788535940.640753:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548361728 00000100:00100000:1.0:1788535940.640816:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:1.0:1788535940.640828:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11423:x1875415548361728:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788535940.640887:0:10016:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535940.640919:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdcd95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655500 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.640939:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:1.0:1788535940.640944:0:10016:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535940.640976:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.640990:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.641001:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535940.641133:0:10016:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000005ca280b6 reply state 000000000b2d1924 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.641234:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.641240:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:1.0:1788535940.641243:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788535940.641246:0:10016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535940.641334:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+17:11423:x1875415548361728:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 508us (779us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1788535940.641342:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:1.0:1788535940.645730:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.645815:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548361856 00000100:00100000:3.0:1788535940.645834:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548361856 00000100:00100000:3.0:1788535940.645924:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1788535940.645935:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548361856:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788535940.646073:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788535940.646077:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788535940 00002000:00010000:3.0:1788535940.646092:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788535940 00002000:00010000:3.0:1788535940.646095:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788535940 -> 1788535940 00002000:00010000:3.0:1788535940.646097:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788535940.646176:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2401:x1875415548361856:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 242us (454us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788535940.646185:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1788535940.650811:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.650914:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548362112 00000100:00100000:3.0:1788535940.650923:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548362112 00000100:00100000:3.0:1788535940.651015:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:3.0:1788535940.651036:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+17:11423:x1875415548362112:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788535940.651113:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.651144:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f2 expref: 17 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.651185:0:10112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.651278:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f2 expref: 17 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.651293:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f2 expref: 17 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.651307:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569403392:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535940.651447:0:10112:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17240 going to sleep for 11 seconds 00000100:00100000:3.0:1788535940.656222:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbf9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569403392:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535940.656253:0:10112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.656393:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.656702:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548362240 00000100:00100000:1.0:1788535940.656721:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548362240 00010000:00010000:1.0:1788535940.656758:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f2 expref: 18 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.656883:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:1.0:1788535940.656893:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+18:2402:x1875415548362240:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535940.656909:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535940.656917:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f2 expref: 18 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.656929:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f2 expref: 18 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.656950:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcd79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f2 expref: 18 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.656984:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:1.0:1788535940.656989:0:10351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.656998:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.657006:0:10351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.657032:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535940.657097:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+17:2402:x1875415548362240:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 205us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.657104:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00010000:00010000:0.0:1788535940.657175:0:10112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.657183:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.657234:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.657242:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.657261:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.657267:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535940.657271:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.657278:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.657288:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:0.0:1788535940.657291:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788535940.657294:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.657301:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdbf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.657342:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11423:x1875415548362112:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 6317us (6539us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788535940.657350:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:0.0:1788535940.662633:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.662728:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548362368 00000100:00100000:3.0:1788535940.662737:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548362368 00000100:00100000:3.0:1788535940.662964:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:3.0:1788535940.662976:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548362368:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788535940.663021:0:10017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.663042:0:10017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.663065:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535940.663069:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535940.663075:0:10017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.663358:0:10017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.663374:0:10017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 7 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.663459:0:10017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10017:1875415569403520:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535940.663540:0:10017:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487a17240 going to sleep for 11 seconds 00000100:00100000:2.0:1788535940.667895:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.667961:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548362496 00000100:00100000:1.0:1788535940.667970:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548362496 00010000:00010000:1.0:1788535940.668007:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 8 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.668049:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:1.0:1788535940.668059:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2399:x1875415548362496:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535940.668074:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535940.668107:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 8 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.668121:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 8 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.668187:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535940.668192:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535940.668198:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.668209:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.668229:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535940.668276:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2399:x1875415548362496:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 219us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.668285:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00010000:00010000:3.0:1788535940.668688:0:10017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbdcda3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165550e expref: 7 pid: 8447 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.668715:0:10017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10017:1875415569403520:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535940.668739:0:10017:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.668750:0:10017:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.668758:0:10017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.668797:0:10017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.668807:0:10017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.668814:0:10017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.668830:0:10017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50800 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:3.0:1788535940.668834:0:10017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.668844:0:10017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.668858:0:10017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.668864:0:10017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af85c29f/0xe79af2f39bbdcdc6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.669286:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548362368:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 6311us (6789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.669296:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1788535940.673343:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.673426:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548362752 00000100:00100000:1.0:1788535940.673435:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548362752 00000100:00100000:1.0:1788535940.673496:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:1.0:1788535940.673517:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+16:11423:x1875415548362752:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788535940.673588:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.673606:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ba expref: 16 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.673617:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.673654:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ba expref: 16 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.673683:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ba expref: 16 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.673698:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569403648:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535940.673795:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876eff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788535940.679733:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569403648:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535940.679762:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.680385:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.680606:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548362880 00000100:00100000:3.0:1788535940.680613:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548362880 00010000:00010000:3.0:1788535940.680652:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ba expref: 17 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.680737:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1788535940.680747:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+17:2401:x1875415548362880:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535940.680762:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535940.680780:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ba expref: 17 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.680800:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ba expref: 17 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.680830:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdccbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554ba expref: 17 pid: 10016 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.680847:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:3.0:1788535940.680854:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554dd expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.680872:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.680880:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.680888:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.680949:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535940.681003:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+16:2401:x1875415548362880:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 257us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.681011:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00010000:00010000:0.0:1788535940.681655:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.681667:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.681856:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.681893:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f9 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.681908:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.681946:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f9 expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.681959:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f9 expref: 16 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.681973:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569403776:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535940.682053:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005acacee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.688295:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.688377:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548363008 00000100:00100000:3.0:1788535940.688386:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548363008 00010000:00010000:3.0:1788535940.688425:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f9 expref: 17 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535940.688467:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:3.0:1788535940.688477:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+17:2401:x1875415548363008:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535940.688491:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535940.688498:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f9 expref: 17 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.688589:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f9 expref: 17 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.688611:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:3.0:1788535940.688616:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.688627:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.688633:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.688669:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535940.688731:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+17:2401:x1875415548363008:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 255us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.688739:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00010000:00010000:1.0:1788535940.688842:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdcd87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554f9 expref: 16 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.688859:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569403776:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535940.688893:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.688911:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.688917:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535940.689024:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788535940.689406:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:1.0:1788535940.689441:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788535940.690195:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875415569403904:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788535940.690270:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535940.690301:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef540 going to sleep for 11 seconds 00000100:00100000:3.0:1788535940.690433:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569403904 00000100:00100000:3.0:1788535940.690441:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569403904 00000100:00100000:3.0:1788535940.690493:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788535940.690574:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6535:x1875415569403904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788535940.690669:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6535:x1875415569403904:12345-0@lo:1000:mdt00_002.0 Request processed in 169us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535940.690675:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788535940.691435:0:6535:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788535940.691443:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788535940.691466:0:6535:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff90058ad6c700 x1875415569403136/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788535956 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535940.691478:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875415569403904:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788535940.691758:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:0.0:1788535940.693760:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875415569404032:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788535940.694004:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535940.694319:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005acace900 going to sleep for 11 seconds 00000100:00100000:3.0:1788535940.694369:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569404032 00000100:00100000:3.0:1788535940.694378:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569404032 00000100:00100000:3.0:1788535940.694466:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788535940.694475:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6535:x1875415569404032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788535940.694739:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6535:x1875415569404032:12345-0@lo:1000:mdt00_002.0 Request processed in 265us (734us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788535940.694747:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788535940.694844:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875415569404032:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788535940.694892:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.694903:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.694911:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.694917:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.694922:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.694931:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.694945:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:1.0:1788535940.694949:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788535940.694953:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.694971:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdcdd4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.694996:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.695002:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.695008:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.695013:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620ee00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.695017:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.695023:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.695044:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:1.0:1788535940.695047:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788535940.695055:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554dd expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.695068:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554dd expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.695077:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554dd expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.695121:0:6535:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554dd expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.695133:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487a83800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569404160:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788535940.695226:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef840 going to sleep for 11 seconds 00000100:00100000:0.0:1788535940.701780:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.704644:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487a83800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569404160:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788535940.704679:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.704691:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdcd17 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.704747:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.704763:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705261:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705275:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705281:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705288:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705312:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.705317:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705334:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705346:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:1.0:1788535940.705349:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535940.705354:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705360:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdcddb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705371:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705376:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705382:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705387:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535940.705389:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705394:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705412:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:1.0:1788535940.705415:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788535940.705418:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.705423:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdcdcd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535940.705595:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11423:x1875415548362752:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 32087us (32258us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788535940.705604:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00000020:00080000:1.0:1788535940.705611:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788535940.706518:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535940.706524:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535940.707256:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788535940.707268:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788535940.707451:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548363136 00000100:00100000:1.0:1788535940.707461:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548363136 00000100:00100000:1.0:1788535940.707518:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1788535940.707528:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11422:x1875415548363136:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:1.0:1788535940.707643:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11422:x1875415548363136:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 116us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535940.707650:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1788535940.711629:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.711897:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548363392 00000100:00100000:1.0:1788535940.711906:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548363392 00000100:00100000:1.0:1788535940.711963:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:1.0:1788535940.711974:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:11423:x1875415548363392:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788535940.712262:0:6537:0:(mdd_object.c:4338:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788535940.712293:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:1.0:1788535940.712339:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.712369:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.712381:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.712390:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.712396:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.712402:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535940.712418:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788535940.712499:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+21:11423:x1875415548363392:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 527us (878us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788535940.712519:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000020:00080000:1.0:1788535940.712524:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788535940.716026:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788535940.716112:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.716123:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:3.0:1788535940.716128:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.716137:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.716732:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:3.0:1788535940.716735:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788535940.716740:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.716747:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdcde2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.716762:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535940.716763:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535940.716765:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535940.717755:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535940.717864:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548363648 00000100:00100000:0.0:1788535940.717873:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548363648 00000100:00100000:0.0:1788535940.717932:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:0.0:1788535940.717942:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+21:11422:x1875415548363648:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:0.0:1788535940.718128:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788535940.718592:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+21:11422:x1875415548363648:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 649us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.718601:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:0.0:1788535940.767247:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535940.767359:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548363776 00000100:00100000:3.0:1788535940.767369:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548363776 00000100:00100000:3.0:1788535940.767429:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:3.0:1788535940.767439:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+21:11425:x1875415548363776:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535940.767462:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535940.767484:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcde9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655515 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.767686:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.767701:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.767725:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.767741:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.767763:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535940.767770:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.768935:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.768956:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554d6 expref: 22 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.768965:0:10112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.769003:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554d6 expref: 22 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.769019:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554d6 expref: 22 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.769033:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569404288:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535940.769184:0:10112:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105900 going to sleep for 11 seconds 00000100:00100000:2.0:1788535940.772985:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569404288:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535940.773013:0:10112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535940.773558:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535940.773638:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548364032 00000100:00100000:1.0:1788535940.773646:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548364032 00000100:00100000:1.0:1788535940.773698:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788535940.773718:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+23:6637:x1875415548364032:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788535940.773946:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+24:6637:x1875415548364032:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 240us (389us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788535940.773955:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788535940.778838:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535940.778995:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548364160 00000100:00100000:2.0:1788535940.779003:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548364160 00010000:00010000:2.0:1788535940.779118:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554d6 expref: 24 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535940.779182:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:2.0:1788535940.779193:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+24:2401:x1875415548364160:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535940.779209:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535940.779216:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554d6 expref: 24 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.779230:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554d6 expref: 24 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.779254:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdcd09 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554d6 expref: 24 pid: 10112 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.779272:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535940.779277:0:10351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.779288:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.779306:0:10351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535940.779469:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535940.779529:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+23:2401:x1875415548364160:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 337us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535940.779537:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00010000:00010000:0.0:1788535940.783567:0:10112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.783585:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535940.783640:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788535940.783644:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535940.783665:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.783681:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.783691:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.783697:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.783717:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.783723:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535940.783727:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.783752:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.783972:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:0.0:1788535940.783976:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535940.783982:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.783989:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcdf0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784008:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784014:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784021:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784026:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535940.784029:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784435:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784449:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff900486936900) 00010000:00010000:0.0:1788535940.784452:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535940.784456:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784473:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdcdf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784522:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdcde9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655515 expref: 23 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784538:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655515 expref: 22 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535940.784545:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:0.0:1788535940.784548:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535940.784550:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067c00, rc 0) 00000100:00100000:0.0:1788535940.784662:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11425:x1875415548363776:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 17223us (17425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535940.784671:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00010000:00010000:3.0:1788535941.292245:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788535941.561309:0:14323:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535941.561318:0:14323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535941.561348:0:14323:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788535941.561354:0:14323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788535941.742359:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535941.742368:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535941.742401:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788535941.742407:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788535941.742534:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569404416:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788535941.742635:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005acacecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535941.746823:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569404416:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788535941.753435:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535941.753712:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548364288 00000100:00100000:1.0:1788535941.753722:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548364288 00000100:00100000:1.0:1788535941.753797:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:1.0:1788535941.753816:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11437:x1875415548364288:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788535941.753854:0:6535:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788535941.753973:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11437:x1875415548364288:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 167us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535941.753981:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00080000:2.0:1788535941.754476:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535941.764275:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535941.764439:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548364544 00000100:00100000:0.0:1788535941.764451:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548364544 00000100:00100000:0.0:1788535941.764511:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:0.0:1788535941.764522:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+22:11437:x1875415548364544:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535941.764543:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535941.764585:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165551c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.764714:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdce0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.764729:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdce0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.764741:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdce0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535941.764753:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788535941.764876:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165551c expref: 25 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.764893:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdce0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165551c expref: 24 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535941.764902:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:0.0:1788535941.764904:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535941.764908:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454a00, rc 0) 00000100:00100000:0.0:1788535941.764974:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+24:11437:x1875415548364544:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 454us (709us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788535941.764999:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:0.0:1788535941.776390:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535941.776443:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535941.776518:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548364800 00000100:00100000:2.0:1788535941.776529:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548364800 00000100:00100000:3.0:1788535941.776550:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548364928 00000100:00100000:3.0:1788535941.776557:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548364928 00000100:00100000:2.0:1788535941.776595:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:2.0:1788535941.776606:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+25:11437:x1875415548364800:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788535941.776619:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1788535941.776630:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+25:2401:x1875415548364928:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535941.776642:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535941.776681:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.776682:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdce0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165551c expref: 25 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.776720:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.776737:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535941.779368:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:3.0:1788535941.779382:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535941.779445:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.779457:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535941.779467:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+25:2401:x1875415548364928:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 2832us (3015us total) trans 0 rc 0/0 00010000:00010000:2.0:1788535941.779467:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535941.779479:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00010000:00010000:2.0:1788535941.779652:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535941.779657:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.779666:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.779680:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535941.779682:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788535941.779687:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535941.779694:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdce1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535941.779886:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+24:11437:x1875415548364800:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 3280us (3505us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788535941.779895:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 144 00000040:00080000:0.0:1788535941.780005:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535941.780011:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535941.781225:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788535941.781237:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788535941.786270:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535941.786760:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548365184 00000100:00100000:1.0:1788535941.786786:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548365184 00000100:00100000:1.0:1788535941.786909:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1788535941.786920:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+24:11437:x1875415548365184:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788535941.787194:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+25:11437:x1875415548365184:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 276us (935us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788535941.787202:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1788535942.060475:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569404928:0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.060488:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569404544:0@lo:400:kworker.0 00000100:00100000:1.0:1788535942.060579:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569404800:0@lo:400:kworker.0 00000100:00100000:3.0:1788535942.060634:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569404672:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.061575:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535942.061639:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569405440:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.061671:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535942.061690:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569405952:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.061720:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535942.061764:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569405440 00000100:00100000:2.0:1788535942.061771:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569405440 00000100:00100000:2.0:1788535942.061817:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569405952 00000100:00100000:2.0:1788535942.061832:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569405952 00000100:00100000:2.0:1788535942.061855:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788535942.061863:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569405440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.061909:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569405440:12345-0@lo:400:kworker.0 Request processed in 46us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.061916:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788535942.061930:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788535942.061935:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569405952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.061958:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569405952:12345-0@lo:400:kworker.0 Request processed in 23us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.061964:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788535942.061983:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535942.061986:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535942.062020:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569405440:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.062032:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569405952:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.062071:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569404928 00000100:00100000:2.0:1788535942.062075:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569404928 00000100:00100000:2.0:1788535942.062103:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788535942.062109:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569404928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.062142:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569404928:12345-0@lo:400:kworker.0 Request processed in 33us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.062256:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788535942.062287:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569404928:0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.068402:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535942.069174:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569405056:0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.069236:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535942.069740:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569405568:0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.069776:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535942.069797:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569406080:0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.069818:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535942.069944:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569405056 00000100:00100000:0.0:1788535942.069953:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569405056 00000100:00100000:0.0:1788535942.070192:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788535942.070202:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569405056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.070936:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569405056:12345-0@lo:400:kworker.0 Request processed in 732us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.070946:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788535942.071141:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569405568 00000100:00100000:0.0:1788535942.071166:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569405568 00000100:00100000:0.0:1788535942.071223:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569406080 00000100:00100000:0.0:1788535942.071226:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569406080 00000100:00100000:0.0:1788535942.071376:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788535942.071385:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569405568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.071498:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569405568:12345-0@lo:400:kworker.0 Request processed in 114us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.071504:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788535942.071516:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788535942.071522:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569406080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.071547:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569406080:12345-0@lo:400:kworker.0 Request processed in 26us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.071553:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1788535942.071572:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535942.071576:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535942.071676:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569405056:0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.071688:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569405568:0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.071711:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569406080:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.074953:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569404544 00000100:00100000:2.0:1788535942.074968:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569404544 00000100:00100000:2.0:1788535942.075067:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788535942.075094:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569404544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.077140:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569404544:12345-0@lo:400:kworker.0 Request processed in 2041us (8737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535942.077176:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788535942.077263:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569404544:0@lo:400:kworker.0 00000100:00100000:1.0:1788535942.078115:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535942.078378:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569404800 00000100:00100000:0.0:1788535942.078387:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569404800 00000100:00100000:0.0:1788535942.078432:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788535942.078442:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569404800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.078500:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569404800:12345-0@lo:400:kworker.0 Request processed in 60us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.078507:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788535942.078570:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569405312:0@lo:400:kworker.0 00000100:00100000:1.0:1788535942.078609:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535942.078639:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569405824:0@lo:400:kworker.0 00000100:00100000:1.0:1788535942.078662:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535942.078686:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569405312 00000100:00100000:1.0:1788535942.078690:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569405312 00000100:00100000:1.0:1788535942.078738:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569405824 00000100:00100000:1.0:1788535942.078741:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569405824 00000100:00100000:1.0:1788535942.078784:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788535942.078790:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569405312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535942.078823:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569405312:12345-0@lo:400:kworker.0 Request processed in 34us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535942.078829:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788535942.078843:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788535942.078849:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569405824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535942.078874:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569405824:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535942.078879:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:1.0:1788535942.078894:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788535942.078922:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fbc6a00 x1875415569405824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535942.078934:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569405824:0@lo:400:kworker.0 00000100:00100000:1.0:1788535942.078958:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569404800:0@lo:400:kworker.0 00010000:00080000:1.0:1788535942.078967:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90058ad6fb80 x1875415569405312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535942.080257:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569405312:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.080586:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535942.080627:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569405184:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.080656:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535942.080679:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569405696:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.080708:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535942.080782:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569404672 00000100:00100000:0.0:1788535942.080789:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569404672 00000100:00100000:0.0:1788535942.080841:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569405184 00000100:00100000:0.0:1788535942.080844:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569405184 00000100:00100000:0.0:1788535942.080868:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569405696 00000100:00100000:0.0:1788535942.080871:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569405696 00000100:00100000:0.0:1788535942.080887:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788535942.080895:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569404672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.080943:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569404672:12345-0@lo:400:kworker.0 Request processed in 48us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.080950:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788535942.080966:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788535942.081106:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569405184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.081141:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569405184:12345-0@lo:400:kworker.0 Request processed in 169us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.081240:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788535942.081255:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788535942.081262:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569405696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535942.081289:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569405696:12345-0@lo:400:kworker.0 Request processed in 29us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535942.081295:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788535942.081420:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569404672:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.081432:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569405184:0@lo:400:kworker.0 00000100:00100000:2.0:1788535942.081440:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569405696:0@lo:400:kworker.0 00000100:00080000:1.0:1788535942.081513:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788535942.317081:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788535942.572868:0:10023:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401376718616ns, next at 402376715911ns, rc = 0 00000100:00100000:1.0:1788535942.572894:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535942.572914:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569406336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535942.572977:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535942.573062:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569406336 00000100:00100000:1.0:1788535942.573069:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569406336 00000100:00100000:1.0:1788535942.573113:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788535942.573122:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3663:x1875415569406336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535942.573187:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788535942.573248:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3663:x1875415569406336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535942.573255:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788535942.573305:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569406336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535942.575029:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569406208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788535942.575098:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535942.575405:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569406208 00000100:00100000:3.0:1788535942.575414:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569406208 00000100:00100000:3.0:1788535942.575467:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788535942.575477:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569406208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535942.575498:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788535942.575572:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569406208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535942.575580:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788535942.576369:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569406208:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788535943.340250:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788535943.458188:0:14374:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535943.458198:0:14374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535943.458228:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788535943.458234:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788535943.581997:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535943.582089:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548365440 00000100:00100000:0.0:1788535943.582098:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548365440 00000100:00100000:0.0:1788535943.582194:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:0.0:1788535943.582205:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+25:11458:x1875415548365440:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535943.582236:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535943.582268:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdce21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655523 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.582366:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdce28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.582381:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdce28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.582392:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdce28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535943.582403:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00080000:2.0:1788535943.582489:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788535943.582501:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454600/0xe79af2f39bbdce21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655523 expref: 28 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.582518:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdce28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655523 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.582526:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:0.0:1788535943.582529:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788535943.582532:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e455400, rc 0) 00000100:00100000:0.0:1788535943.582590:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+27:11458:x1875415548365440:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 388us (603us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788535943.582597:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:0.0:1788535943.586388:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535943.586436:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548365568 00000100:00100000:3.0:1788535943.586447:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548365568 00000100:00100000:3.0:1788535943.586515:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:3.0:1788535943.586526:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+27:11458:x1875415548365568:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1788535943.586589:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.586606:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.586618:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.586653:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.586661:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.586669:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.586675:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535943.586680:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.586720:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.586736:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:3.0:1788535943.586739:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535943.586744:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535943.586752:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdce36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535943.586849:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+27:11458:x1875415548365568:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 324us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.586857:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:3.0:1788535943.601552:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569406464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535943.601660:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535943.601773:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569406464 00000100:00100000:3.0:1788535943.601781:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569406464 00000100:00100000:1.0:1788535943.602408:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788535943.602420:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569406592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535943.602477:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535943.602522:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569406592 00000100:00100000:1.0:1788535943.602527:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569406592 00000100:00100000:1.0:1788535943.602572:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788535943.602582:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875415569406592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535943.602609:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535943.602655:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875415569406592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535943.602663:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788535943.602735:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569406592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535943.603036:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788535943.603045:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569406464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788535943.603057:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535943.603096:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569406464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535943.603102:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788535943.603137:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569406464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535943.685643:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535943.685819:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548365696 00000100:00100000:0.0:1788535943.685829:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548365696 00000100:00100000:0.0:1788535943.685925:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1788535943.685936:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2400:x1875415548365696:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1788535943.685954:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535943.685975:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdce3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165552a expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535943.686002:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ae484, atime: 0x6a9ae484, ctime: 0x6a9ae484, blocks: 0x8 00010000:00010000:0.0:1788535943.686022:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1788535943.686027:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535943.686037:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdce3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165552a expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.686056:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdce3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165552a expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535943.686069:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454600, rc 0) 00000100:00100000:0.0:1788535943.686129:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2400:x1875415548365696:12345-192.168.203.13@tcp:101:cat.0 Request processed in 196us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535943.686136:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00080000:2.0:1788535943.686489:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535943.692650:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535943.692768:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548365824 00000100:00100000:0.0:1788535943.692778:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548365824 00002000:00100000:0.0:1788535943.692836:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff90059fbc5880 x1875415548365824/t0(0) o3->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:599/0 lens 488/0 e 0 to 0 dl 1788535954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535943.692846:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fbc5880 with x1875415548365824 ext(0->4095) 00002000:00010000:0.0:1788535943.692853:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fbc5880 00000100:00100000:0.0:1788535943.692892:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1788535943.692915:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2399:x1875415548365824:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:0.0:1788535943.693103:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2399:x1875415548365824:12345-192.168.203.13@tcp:3:cat.0 Request processed in 189us (462us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788535943.693111:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:0.0:1788535943.693118:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff90059fbc5880 x1875415548365824/t0(0) o3->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:599/0 lens 488/4536 e 0 to 0 dl 1788535954 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535943.693125:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fbc5880 with x1875415548365824 ext(0->4095) 00002000:00010000:0.0:1788535943.693128:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fbc5880 00000100:00100000:1.0:1788535944.108397:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569406720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788535944.108474:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535944.108614:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569406720 00000100:00100000:0.0:1788535944.108624:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569406720 00000100:00100000:0.0:1788535944.108676:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788535944.108697:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569406720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788535944.108735:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535944.108799:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569406720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535944.108805:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788535944.108910:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569406720:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788535944.364268:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535944.622493:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535944.622520:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569406848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535944.622589:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535944.622655:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569406848 00000100:00100000:3.0:1788535944.622662:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569406848 00000100:00100000:3.0:1788535944.622723:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788535944.622732:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569406848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535944.623005:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788535944.623056:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569406848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 325us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535944.623062:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788535944.623106:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569406848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535945.086504:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535945.086545:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535945.086567:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535945.086594:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535945.086612:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535945.086630:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535945.086652:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535945.086693:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548366080 00000100:00100000:3.0:1788535945.086703:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548366080 00000100:00100000:3.0:1788535945.086760:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548366592 00000100:00100000:3.0:1788535945.086764:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548366592 00000100:00100000:3.0:1788535945.086779:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548366208 00000100:00100000:3.0:1788535945.086782:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548366208 00000100:00100000:3.0:1788535945.086800:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548366720 00000100:00100000:3.0:1788535945.086803:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548366720 00000100:00100000:3.0:1788535945.086822:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:3.0:1788535945.086832:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+27:2399:x1875415548366080:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535945.086919:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+27:2399:x1875415548366080:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 89us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535945.086927:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:3.0:1788535945.086947:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 277 00000100:00100000:3.0:1788535945.086954:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548366592:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535945.086978:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548366592:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535945.086984:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 277 00000100:00100000:3.0:1788535945.086996:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:3.0:1788535945.087002:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548366208:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535945.087026:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548366208:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535945.087031:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:3.0:1788535945.087043:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 279 00000100:00100000:3.0:1788535945.087048:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548366720:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535945.087072:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548366720:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535945.087079:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 279 00000100:00100000:3.0:1788535945.087097:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548365952 00000100:00100000:3.0:1788535945.087100:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548365952 00000100:00100000:3.0:1788535945.087124:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 379 00000100:00100000:3.0:1788535945.087130:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548365952:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535945.087173:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548365952:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535945.087185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 379 00000100:00080000:3.0:1788535945.087215:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535945.087219:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535945.087653:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548366336 00000100:00100000:0.0:1788535945.087659:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548366336 00000100:00100000:0.0:1788535945.087711:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548366464 00000100:00100000:0.0:1788535945.087715:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548366464 00000100:00100000:0.0:1788535945.087750:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:0.0:1788535945.087759:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2399:x1875415548366336:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535945.087807:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2399:x1875415548366336:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 48us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535945.087814:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:0.0:1788535945.087837:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:0.0:1788535945.087843:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2399:x1875415548366464:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535945.087869:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2399:x1875415548366464:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535945.087874:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00080000:3.0:1788535945.088238:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535945.088242:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788535945.388330:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788535946.161550:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788535946.161566:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788535946.161576:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000004:00080000:0.0:1788535946.161584:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00010000:00010000:3.0:1788535946.161592:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535946.161603:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788535946.161610:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9004876ef540 refcount 2 committed 0 result 0 batchid 4 00010000:00010000:3.0:1788535946.161611:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788535946.161614:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90058934bf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9004876ef3c0 00010000:00010000:3.0:1788535946.161617:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f600 already unused, calling callback (ffffffffc181c4f0) 00000020:00080000:0.0:1788535946.161617:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90058934b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9004879c5c00 00010000:00010000:3.0:1788535946.161622:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535946.161630:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788535946.161638:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1788535946.161649:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff900486936100) 00010000:00010000:3.0:1788535946.161652:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535946.161657:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535946.161664:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcdb8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535946.161785:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535946.161803:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569406976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788535946.161863:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535946.161883:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569406976 00000100:00100000:0.0:1788535946.161890:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569406976 00000100:00080000:3.0:1788535946.161929:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788535946.161968:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788535946.161978:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3662:x1875415569406976:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1788535946.162191:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00002000:00010000:0.0:1788535946.162199:0:8448:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788535946.162202:0:8448:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788535940 -> 1788535940 00002000:00010000:0.0:1788535946.162204:0:8448:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1788535940 -> 1788535940 00002000:00010000:0.0:1788535946.162207:0:8448:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788535940 -> 1788535940 00002000:00010000:0.0:1788535946.162209:0:8448:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000020:00080000:3.0:1788535946.162234:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1788535946.162256:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3662:x1875415569406976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 279us (391us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788535946.162263:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1788535946.162273:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9004883d4700/2, rc 0, transno 4294967313 00000100:00100000:3.0:1788535946.162279:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569406976:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1788535946.164965:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788535946.164980:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000040:00080000:0.0:1788535946.284796:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788535946.419338:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788535946.924372:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535946.924384:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535946.924405:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788535946.924416:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535947.180881:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569407232:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.180948:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535947.181016:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569407744:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.181048:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535947.181069:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569408256:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.181088:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535947.181110:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788535947.181116:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569407104:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.181143:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535947.181184:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569407616:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.181521:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535947.181541:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569408128:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.181575:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535947.181591:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569408640:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.181612:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535947.181742:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569407232 00000100:00100000:1.0:1788535947.181749:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569407232 00000100:00100000:1.0:1788535947.181798:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569407744 00000100:00100000:1.0:1788535947.181801:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569407744 00000100:00100000:1.0:1788535947.181823:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569408256 00000100:00100000:1.0:1788535947.181825:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569408256 00000100:00100000:1.0:1788535947.181841:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788535947.181848:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569407232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535947.181897:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569407232:12345-0@lo:400:kworker.0 Request processed in 49us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535947.181904:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788535947.181920:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788535947.181925:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569407744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535947.181950:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569407744:12345-0@lo:400:kworker.0 Request processed in 25us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535947.181956:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788535947.181965:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788535947.181970:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569408256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535947.181990:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569408256:12345-0@lo:400:kworker.0 Request processed in 21us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535947.181995:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788535947.182070:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569407360:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182101:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535947.182129:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569407872:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182179:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535947.182197:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569408384:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182231:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535947.182244:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788535947.182249:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569407488:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182269:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535947.182278:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569408000:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182300:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535947.182315:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569408512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182332:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535947.182359:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569407104 00000100:00100000:0.0:1788535947.182363:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569407104 00000100:00100000:0.0:1788535947.182388:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788535947.182394:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569407104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182423:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569407104:12345-0@lo:400:kworker.0 Request processed in 29us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.182428:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788535947.182452:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569408128 00000100:00100000:0.0:1788535947.182456:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569408128 00000100:00100000:0.0:1788535947.182474:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569408640 00000100:00100000:0.0:1788535947.182477:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569408640 00000100:00100000:0.0:1788535947.182488:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569408000 00000100:00100000:0.0:1788535947.182490:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569408000 00000100:00100000:0.0:1788535947.182520:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569408512 00000100:00100000:0.0:1788535947.182523:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569408512 00000100:00100000:0.0:1788535947.182537:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788535947.182543:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569408128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182586:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569408128:12345-0@lo:400:kworker.0 Request processed in 43us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.182592:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788535947.182604:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788535947.182610:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569408640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182633:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569408640:12345-0@lo:400:kworker.0 Request processed in 24us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.182638:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788535947.182648:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788535947.182654:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569408000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182695:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569408000:12345-0@lo:400:kworker.0 Request processed in 42us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.182701:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788535947.182714:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788535947.182720:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569408512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182745:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569408512:12345-0@lo:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.182750:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788535947.182787:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569408000:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182796:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569408512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182816:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569407872 00000100:00100000:0.0:1788535947.182826:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569407872 00000100:00100000:0.0:1788535947.182845:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569408384 00000100:00100000:0.0:1788535947.182848:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569408384 00000100:00100000:0.0:1788535947.182859:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569407488 00000100:00100000:0.0:1788535947.182861:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569407488 00000100:00100000:0.0:1788535947.182872:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788535947.182877:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569407872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182917:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569407872:12345-0@lo:400:kworker.0 Request processed in 39us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.182922:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788535947.182933:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788535947.182939:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569408384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.182964:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569408384:12345-0@lo:400:kworker.0 Request processed in 26us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.182969:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788535947.182980:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788535947.182985:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569407488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.183009:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569407488:12345-0@lo:400:kworker.0 Request processed in 24us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535947.183015:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788535947.183038:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569407488:0@lo:400:kworker.0 00010000:00080000:0.0:1788535947.183050:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488920000 x1875415569407872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535947.183061:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569407872:0@lo:400:kworker.0 00010000:00080000:0.0:1788535947.183071:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488921500 x1875415569408384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535947.183092:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569408384:0@lo:400:kworker.0 00000100:00100000:3.0:1788535947.184701:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569407616 00000100:00100000:3.0:1788535947.184713:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569407616 00000100:00100000:3.0:1788535947.184751:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569407360 00000100:00100000:3.0:1788535947.184754:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569407360 00000100:00100000:3.0:1788535947.184770:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788535947.184777:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569407616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535947.184847:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569407616:12345-0@lo:400:kworker.0 Request processed in 71us (3326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535947.184855:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788535947.184870:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788535947.184876:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569407360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535947.184921:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569407360:12345-0@lo:400:kworker.0 Request processed in 44us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535947.184927:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788535947.184945:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535947.184950:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535947.184952:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535947.184955:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535947.185223:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569407104:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.185238:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569407616:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.185249:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788535947.185254:0:3661:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1788535947.185289:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90048816bb80, transno 4294967305 00000100:00100000:2.0:1788535947.185301:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569408128:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.185313:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788535947.185316:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90058ad6c700, transno 4294967310 00000004:00080000:2.0:1788535947.185330:0:3661:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788535947.185353:0:3661:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9004883d4700 x1875415569406976/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788535962 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535947.185363:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569408640:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.185378:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569407232:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.185389:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569407744:0@lo:400:kworker.0 00000100:00100000:2.0:1788535947.185399:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569408256:0@lo:400:kworker.0 00000100:00100000:0.0:1788535947.185773:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569407360:0@lo:400:kworker.0 00010000:00010000:3.0:1788535947.436265:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535947.692410:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535947.692431:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569408768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535947.692503:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535947.692588:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569408768 00000100:00100000:1.0:1788535947.692596:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569408768 00000100:00100000:1.0:1788535947.692646:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788535947.692664:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1875415569408768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535947.692707:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788535947.692751:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1875415569408768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535947.692759:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788535947.692807:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569408768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535947.702275:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569408896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535947.703301:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535947.703521:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569408896 00000100:00100000:3.0:1788535947.703530:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569408896 00000100:00100000:3.0:1788535947.703576:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788535947.703585:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569408896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535947.703622:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788535947.703695:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569408896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535947.703702:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788535947.703903:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569408896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535948.325938:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535948.326741:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548366848 00000100:00100000:1.0:1788535948.326753:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548366848 00000100:00100000:1.0:1788535948.326831:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:1.0:1788535948.326844:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+13:11103:x1875415548366848:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1788535948.326848:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535948.327501:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+13:11103:x1875415548366848:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 658us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535948.327511:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:0.0:1788535948.336494:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535948.336580:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548366976 00000100:00100000:3.0:1788535948.336589:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548366976 00000100:00100000:3.0:1788535948.336670:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:3.0:1788535948.336680:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:11103:x1875415548366976:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788535948.336782:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:11103:x1875415548366976:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535948.336790:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00080000:0.0:1788535948.336855:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535948.343134:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535948.343264:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548367232 00000100:00100000:0.0:1788535948.343274:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548367232 00000100:00100000:0.0:1788535948.343327:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1788535948.343334:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+13:11103:x1875415548367232:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788535948.343533:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+14:11103:x1875415548367232:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 198us (407us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788535948.343542:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00010000:00010000:1.0:1788535948.460519:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535948.716496:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535948.716519:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569409024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535948.716586:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535948.716779:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569409024 00000100:00100000:1.0:1788535948.716900:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569409024 00000100:00100000:1.0:1788535948.716953:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788535948.716962:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569409024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535948.716988:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535948.717039:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569409024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535948.717046:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788535948.717132:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569409024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535948.717579:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535948.717592:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569409152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535948.717629:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535948.717759:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569409152 00000100:00100000:0.0:1788535948.717877:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569409152 00000100:00100000:0.0:1788535948.717915:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788535948.717923:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569409152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788535948.717938:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535948.717981:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569409152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535948.717986:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788535948.718065:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569409152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788535948.787255:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535948.787604:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548367360 00000100:00100000:2.0:1788535948.787612:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548367360 00000100:00100000:2.0:1788535948.787698:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:2.0:1788535948.787709:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:11916:x1875415548367360:12345-192.168.203.13@tcp:101:lsof.0 00010000:00010000:2.0:1788535948.787953:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535948.787975:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066400/0xe79af2f39bbdce44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655531 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535948.788034:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535948.788049:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535948.788060:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535948.788103:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788535948.788107:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788535948.788144:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535948.788279:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066400/0xe79af2f39bbdce44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655531 expref: 7 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535948.788298:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655531 expref: 6 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535948.788308:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:2.0:1788535948.788311:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535948.788315:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066000, rc 0) 00000100:00100000:2.0:1788535948.788411:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:11916:x1875415548367360:12345-192.168.203.13@tcp:101:lsof.0 Request processed in 704us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535948.788419:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00080000:0.0:1788535948.788482:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535949.228952:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535949.228973:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569409280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788535949.229037:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535949.229229:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569409280 00000100:00100000:0.0:1788535949.229238:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569409280 00000100:00100000:0.0:1788535949.229290:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788535949.229299:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569409280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788535949.229331:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535949.229551:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569409280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 253us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535949.229559:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788535949.229640:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569409280:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535949.484354:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535949.740469:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535949.740492:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569409408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535949.740557:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535949.740734:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569409408 00000100:00100000:3.0:1788535949.740741:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569409408 00000100:00100000:3.0:1788535949.741005:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788535949.741016:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569409408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535949.741116:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788535949.741291:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569409408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 276us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535949.741298:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788535949.742336:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569409408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535950.202310:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535950.202369:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535950.202397:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535950.202427:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535950.202447:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535950.202470:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535950.202492:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535950.202516:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548367744 00000100:00100000:1.0:1788535950.202525:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548367744 00000100:00100000:1.0:1788535950.202577:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548368256 00000100:00100000:1.0:1788535950.202580:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548368256 00000100:00100000:1.0:1788535950.202594:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548367616 00000100:00100000:1.0:1788535950.202597:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548367616 00000100:00100000:1.0:1788535950.202608:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548368128 00000100:00100000:1.0:1788535950.202610:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548368128 00000100:00100000:1.0:1788535950.202625:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:1.0:1788535950.202634:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548367744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535950.202721:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548367744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535950.202728:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:1.0:1788535950.202745:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 287 00000100:00100000:1.0:1788535950.202752:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548368256:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535950.202776:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548368256:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535950.202782:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 287 00000100:00100000:1.0:1788535950.202794:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:1.0:1788535950.202800:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+14:2399:x1875415548367616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535950.202826:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+14:2399:x1875415548367616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535950.202839:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:1.0:1788535950.202851:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 289 00000100:00100000:1.0:1788535950.202857:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2399:x1875415548368128:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535950.202881:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2399:x1875415548368128:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535950.202887:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 289 00000100:00100000:0.0:1788535950.203071:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548368000 00000100:00100000:0.0:1788535950.203076:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548368000 00000100:00100000:0.0:1788535950.203112:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548367872 00000100:00100000:0.0:1788535950.203115:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548367872 00000100:00100000:0.0:1788535950.203136:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:0.0:1788535950.203142:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2399:x1875415548368000:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535950.203207:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2399:x1875415548368000:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 64us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535950.203213:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:0.0:1788535950.203227:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:0.0:1788535950.203233:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548367872:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535950.203271:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548367872:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 38us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535950.203278:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00080000:0.0:1788535950.203298:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535950.203302:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535950.203304:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788535950.203313:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535950.203742:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548367488 00000100:00100000:2.0:1788535950.203748:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548367488 00000100:00100000:2.0:1788535950.203823:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 381 00000100:00100000:2.0:1788535950.203831:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548367488:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535950.203874:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548367488:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535950.203881:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 381 00010000:00010000:3.0:1788535950.508382:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535951.532423:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788535952.259841:0:14571:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 11:32:31 (1788535951) 00000100:00100000:2.0:1788535952.301530:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569409664:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.301608:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.301665:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569410176:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.301698:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.301721:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569410688:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.301742:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.301767:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788535952.301773:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569409792:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.301799:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.301816:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569410304:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.301838:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535952.301845:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569409920:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.301858:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569410816:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.301892:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.301923:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569409664 00000100:00100000:3.0:1788535952.301927:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569410432:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.301931:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569409664 00000100:00100000:3.0:1788535952.301958:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.301975:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569410176 00000100:00100000:3.0:1788535952.301980:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569410944:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.301980:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569410176 00000100:00100000:3.0:1788535952.302005:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.302013:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569410688 00000100:00100000:2.0:1788535952.302017:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569410688 00000100:00100000:3.0:1788535952.302030:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788535952.302035:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569410304 00000100:00100000:2.0:1788535952.302038:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569410304 00000100:00100000:3.0:1788535952.302040:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569409536:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.302053:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569409920 00000100:00100000:2.0:1788535952.302057:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569409920 00000100:00100000:3.0:1788535952.302074:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.302078:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788535952.302088:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569409664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302103:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569410048:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302126:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535952.302161:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569410560:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.302175:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569409664:12345-0@lo:400:kworker.0 Request processed in 87us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535952.302183:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788535952.302190:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.302203:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788535952.302210:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569411072:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.302214:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569410176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302239:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535952.302253:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569410176:12345-0@lo:400:kworker.0 Request processed in 42us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535952.302269:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788535952.302287:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788535952.302294:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569410688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302303:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788535952.302315:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569410304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.302328:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569410688:12345-0@lo:400:kworker.0 Request processed in 33us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535952.302334:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788535952.302349:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788535952.302360:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569409920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302361:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569410304:12345-0@lo:400:kworker.0 Request processed in 46us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.302371:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788535952.302399:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569409920:12345-0@lo:400:kworker.0 Request processed in 44us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.302402:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569409792 00000100:00100000:2.0:1788535952.302407:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788535952.302408:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569409792 00000100:00080000:2.0:1788535952.302428:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535952.302431:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569410048 00000100:00080000:2.0:1788535952.302434:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535952.302435:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569410048 00000100:00100000:3.0:1788535952.302454:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788535952.302462:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569409792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.302466:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569409920:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302498:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569409792:12345-0@lo:400:kworker.0 Request processed in 36us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.302504:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788535952.302518:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788535952.302525:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569410048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302554:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569410048:12345-0@lo:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.302562:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788535952.302568:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569410432 00000100:00100000:1.0:1788535952.302573:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569410432 00000100:00100000:3.0:1788535952.302587:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569410944 00000100:00100000:3.0:1788535952.302592:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569410944 00000100:00100000:1.0:1788535952.302603:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569410560 00000100:00100000:1.0:1788535952.302608:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569410560 00000100:00100000:3.0:1788535952.302618:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569411072 00000100:00100000:3.0:1788535952.302622:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569411072 00000100:00100000:1.0:1788535952.302643:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788535952.302652:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569410432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302659:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788535952.302668:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569410944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535952.302689:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569410432:12345-0@lo:400:kworker.0 Request processed in 38us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535952.302696:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788535952.302711:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569410944:12345-0@lo:400:kworker.0 Request processed in 44us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535952.302715:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788535952.302724:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569410560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302749:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788535952.302755:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569410560:12345-0@lo:400:kworker.0 Request processed in 31us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535952.302763:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788535952.302769:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788535952.302779:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569411072:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788535952.302782:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535952.302786:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535952.302814:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569411072:12345-0@lo:400:kworker.0 Request processed in 37us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.302820:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788535952.302841:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569409536 00000100:00100000:3.0:1788535952.302844:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569409536 00000100:00100000:3.0:1788535952.302876:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788535952.302883:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3662:x1875415569409536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302912:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3662:x1875415569409536:12345-0@lo:400:kworker.0 Request processed in 30us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535952.302917:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788535952.302947:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535952.302984:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569409664:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.302995:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569410176:0@lo:400:kworker.0 00000100:00100000:3.0:1788535952.303004:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569410688:0@lo:400:kworker.0 00000100:00100000:1.0:1788535952.303024:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569410816 00000100:00100000:3.0:1788535952.303026:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569409792:0@lo:400:kworker.0 00000100:00100000:1.0:1788535952.303030:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569410816 00010000:00080000:3.0:1788535952.303041:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048891e680 x1875415569410304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535952.303052:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569410304:0@lo:400:kworker.0 00000100:00100000:1.0:1788535952.303067:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788535952.303083:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569410816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535952.303133:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569410816:12345-0@lo:400:kworker.0 Request processed in 52us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535952.303139:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:1.0:1788535952.303176:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535952.303280:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569409536:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.303290:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569410048:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.303309:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569410560:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.303318:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569411072:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.303326:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569410432:0@lo:400:kworker.0 00000100:00100000:2.0:1788535952.303334:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569410944:0@lo:400:kworker.0 00010000:00080000:3.0:1788535952.304075:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048891fb80 x1875415569410816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535952.304102:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569410816:0@lo:400:kworker.0 00000001:00080000:1.0:1788535952.306859:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:1.0:1788535952.306882:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788535952.306971:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788535952.306983:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1788535952.318324:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00010000:00010000:0.0:1788535952.559011:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535952.814422:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569411328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535952.814485:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535952.814552:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788535952.814558:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569411200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535952.814580:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535952.814609:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569411328 00000100:00100000:0.0:1788535952.814616:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569411328 00000100:00100000:0.0:1788535952.814663:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569411200 00000100:00100000:0.0:1788535952.814666:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569411200 00000100:00100000:0.0:1788535952.814680:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788535952.814687:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569411328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788535952.814713:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788535952.814757:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569411328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535952.814764:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788535952.814780:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788535952.814787:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569411200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535952.814796:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788535952.814819:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569411200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535952.814825:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788535952.814861:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569411200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535952.814882:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788535952.814887:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9004883d4700, transno 4294967313 00000100:00100000:0.0:1788535952.814906:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569411328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788535953.580368:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535953.609870:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535953.609969:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548368512 00000100:00100000:2.0:1788535953.609979:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548368512 00000100:00100000:2.0:1788535953.610052:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:2.0:1788535953.610063:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+13:12183:x1875415548368512:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535953.610081:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535953.610102:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066400/0xe79af2f39bbdce52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655538 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610199:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610213:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610224:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788535953.610359:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788535953.610411:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610420:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610428:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610515:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdce67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610524:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdce67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610545:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdce67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535953.610555:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788535953.610637:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610645:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610651:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610657:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535953.610661:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610668:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610680:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff900583670b00) 00010000:00010000:2.0:1788535953.610683:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535953.610687:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610694:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdce59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610708:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610714:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610726:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610732:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535953.610735:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610741:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610749:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff900590854e00) 00010000:00010000:2.0:1788535953.610751:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535953.610754:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.610760:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdce60 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.611776:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066400/0xe79af2f39bbdce52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655538 expref: 16 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.611796:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdce67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655538 expref: 15 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.611804:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:2.0:1788535953.611807:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535953.611810:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066200, rc 0) 00000100:00100000:2.0:1788535953.611873:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+15:12183:x1875415548368512:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1813us (2011us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788535953.611892:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:1.0:1788535953.617556:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535953.617655:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535953.617737:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548368768 00000100:00100000:2.0:1788535953.617746:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548368768 00000100:00100000:2.0:1788535953.617815:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1788535953.617824:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+15:2399:x1875415548368768:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535953.617838:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535953.617862:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdce67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655538 expref: 15 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535953.617883:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:2.0:1788535953.617886:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535953.617931:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+14:2399:x1875415548368768:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535953.617938:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1788535953.618120:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548368640 00000100:00100000:3.0:1788535953.618125:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548368640 00000100:00100000:3.0:1788535953.618192:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:3.0:1788535953.618201:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+14:12183:x1875415548368640:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788535953.618283:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+14:12183:x1875415548368640:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 84us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535953.618290:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:1.0:1788535953.622914:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535953.625467:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548368896 00000100:00100000:3.0:1788535953.625483:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548368896 00000100:00100000:3.0:1788535953.625627:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:3.0:1788535953.625641:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:12183:x1875415548368896:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788535953.625796:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:12183:x1875415548368896:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 160us (2892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535953.625805:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00080000:1.0:1788535953.629341:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535953.837418:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535953.837438:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569411456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535953.837501:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535953.837562:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569411456 00000100:00100000:0.0:1788535953.837568:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569411456 00000100:00100000:0.0:1788535953.837635:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788535953.837644:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569411456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788535953.837671:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788535953.837715:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569411456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535953.837722:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788535953.837765:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569411456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535953.838323:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569411584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535953.838357:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535953.841457:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569411584 00000100:00100000:3.0:1788535953.841470:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569411584 00000100:00100000:3.0:1788535953.841541:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788535953.841552:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569411584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535953.841586:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535953.841683:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569411584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (3323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535953.841691:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788535953.842007:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569411584:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788535954.092291:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535954.092299:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535954.092809:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788535954.092818:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788535954.351310:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535954.351333:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569411712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788535954.351401:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535954.352564:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569411712 00000100:00100000:0.0:1788535954.352575:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569411712 00000100:00100000:0.0:1788535954.352630:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788535954.352639:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569411712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788535954.352670:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535954.352745:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569411712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535954.352761:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788535954.352809:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569411712:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788535954.481495:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788535954.614432:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535954.860827:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569411840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535954.860893:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535954.861011:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569411840 00000100:00100000:0.0:1788535954.861018:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569411840 00000100:00100000:0.0:1788535954.861109:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788535954.861119:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569411840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788535954.861180:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788535954.861231:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569411840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535954.861238:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788535954.863506:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569411840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535955.327236:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.327285:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.327321:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.327345:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.327374:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548369280 00000100:00100000:3.0:1788535955.327383:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548369280 00000100:00100000:3.0:1788535955.327431:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548369792 00000100:00100000:3.0:1788535955.327435:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548369792 00000100:00100000:3.0:1788535955.327459:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:3.0:1788535955.327469:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548369280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535955.327535:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2399:x1875415548369280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535955.327543:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:3.0:1788535955.327560:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 297 00000100:00100000:3.0:1788535955.327566:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548369792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535955.327590:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2399:x1875415548369792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535955.327595:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 297 00000100:00100000:1.0:1788535955.327692:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548369536 00000100:00100000:1.0:1788535955.327696:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548369536 00000100:00100000:1.0:1788535955.327733:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:1.0:1788535955.327739:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2399:x1875415548369536:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535955.327766:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2399:x1875415548369536:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535955.327772:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00080000:1.0:1788535955.327788:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535955.327793:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535955.328100:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548369024 00000100:00100000:0.0:1788535955.328105:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548369024 00000100:00100000:0.0:1788535955.328133:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 383 00000100:00100000:0.0:1788535955.328141:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548369024:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535955.328202:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005893b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2399:x1875415548369024:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 62us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535955.328210:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 383 00000100:00100000:3.0:1788535955.333347:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.333395:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.333423:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.333455:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548369152 00000100:00100000:3.0:1788535955.333474:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548369152 00000100:00100000:3.0:1788535955.333529:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548369664 00000100:00100000:3.0:1788535955.333533:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548369664 00000100:00100000:3.0:1788535955.333555:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00100000:3.0:1788535955.333565:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+14:2400:x1875415548369152:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535955.333642:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+14:2400:x1875415548369152:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535955.333650:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00100000:3.0:1788535955.333668:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 299 00000100:00100000:3.0:1788535955.333680:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2400:x1875415548369664:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535955.333707:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2400:x1875415548369664:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535955.333725:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 299 00000100:00080000:1.0:1788535955.333810:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788535955.334121:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548369408 00000100:00100000:2.0:1788535955.334127:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548369408 00000100:00100000:2.0:1788535955.334186:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:2.0:1788535955.334194:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548369408:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535955.334227:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548369408:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535955.334241:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00080000:1.0:1788535955.334296:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535955.598049:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535955.598117:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548369920 00000100:00100000:0.0:1788535955.598127:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548369920 00000100:00100000:0.0:1788535955.602138:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:0.0:1788535955.602174:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+14:12226:x1875415548369920:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535955.602196:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535955.602218:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdce75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165553f expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602301:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602316:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602329:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602344:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602351:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602358:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602399:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602406:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602412:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602418:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535955.602422:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602441:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602453:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:0.0:1788535955.602456:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535955.602461:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602468:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455e00/0xe79af2f39bbdce7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602479:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602484:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602489:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602493:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535955.602496:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602500:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602506:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9005893b0000) 00010000:00010000:0.0:1788535955.602508:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535955.602511:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602527:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455200/0xe79af2f39bbdce83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602557:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdce75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165553f expref: 15 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602567:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:0.0:1788535955.602569:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535955.602573:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e454a00/0xe79af2f39bbdce75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165553f expref: 15 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.602582:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059e454a00, rc 0) 00000100:00100000:0.0:1788535955.602653:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+14:12226:x1875415548369920:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 486us (4611us total) trans 0 rc 301/301 00000100:00100000:0.0:1788535955.602660:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:0.0:1788535955.607716:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535955.607752:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548370176 00000100:00100000:0.0:1788535955.607761:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548370176 00000100:00100000:0.0:1788535955.607814:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:0.0:1788535955.607825:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+14:12226:x1875415548370176:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:0.0:1788535955.607877:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535955.607902:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbdc7c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655363 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.607920:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:0.0:1788535955.607925:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535955.607987:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.608002:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655531 expref: 5 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.608011:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.608042:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655531 expref: 5 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.608056:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655531 expref: 5 pid: 10112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535955.608071:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569411968:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535955.608165:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105840 going to sleep for 11 seconds 00000100:00100000:0.0:1788535955.611650:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569411968:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535955.611685:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535955.615423:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.618743:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548370304 00000100:00100000:3.0:1788535955.618756:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548370304 00010000:00010000:3.0:1788535955.618798:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655531 expref: 6 pid: 10112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535955.618834:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:3.0:1788535955.618843:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2401:x1875415548370304:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535955.618856:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535955.618863:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655531 expref: 6 pid: 10112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.618876:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655531 expref: 6 pid: 10112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.618909:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdce4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655531 expref: 6 pid: 10112 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.618924:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:3.0:1788535955.618929:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.618938:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.618944:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.618971:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535955.619024:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548370304:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 181us (3610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535955.619032:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00010000:00010000:3.0:1788535955.619266:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619275:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619296:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619305:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619314:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619778:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619787:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619793:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535955.619805:0:6533:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000055dec0be reply state 00000000a02a16f1 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619815:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619821:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535955.619824:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535955.619827:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788535955.619832:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788535955.619838:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619844:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619850:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619854:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535955.619858:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619874:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619884:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936300) 00010000:00010000:3.0:1788535955.619886:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535955.619890:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619896:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455a00/0xe79af2f39bbdce8a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535955.619912:0:6533:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000055dec0be reply state 00000000a02a16f1 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619921:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.619927:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff900487807200) 00010000:00010000:3.0:1788535955.619929:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535955.619931:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788535955.619989:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+15:12226:x1875415548370176:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 12164us (12280us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788535955.619996:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 154 00010000:00010000:0.0:1788535955.628278:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535955.695873:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535955.696051:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548370432 00000100:00100000:1.0:1788535955.696060:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548370432 00000100:00100000:1.0:1788535955.696133:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:1.0:1788535955.696143:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+15:12234:x1875415548370432:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:1.0:1788535955.696191:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535955.696214:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdce9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655546 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.696274:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcea6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.696286:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.696296:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535955.696339:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788535955.696343:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535955.696365:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.696388:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdce9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655546 expref: 17 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.696406:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcea6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655546 expref: 16 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.696414:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464900) 00010000:00010000:1.0:1788535955.696417:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535955.696420:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e600, rc 0) 00000100:00100000:1.0:1788535955.696475:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+16:12234:x1875415548370432:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 333us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535955.696488:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:3.0:1788535955.744674:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535955.744791:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548370560 00000100:00100000:0.0:1788535955.744802:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548370560 00000100:00100000:0.0:1788535955.744859:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:0.0:1788535955.744869:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+16:12240:x1875415548370560:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788535955.744889:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535955.744910:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdcead lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165554d expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.744987:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745002:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745013:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745025:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745033:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745041:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745112:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838e00/0xe79af2f39bbdcec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745121:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838e00/0xe79af2f39bbdcec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745128:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838e00/0xe79af2f39bbdcec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535955.745201:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788535955.745205:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535955.745224:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488838e00/0xe79af2f39bbdcec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745248:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745255:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745262:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745280:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535955.745285:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745292:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745305:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464900) 00010000:00010000:0.0:1788535955.745308:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535955.745312:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745319:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdceb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745333:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745340:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745347:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745358:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535955.745361:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745368:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745376:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff900487807200) 00010000:00010000:0.0:1788535955.745378:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535955.745381:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745388:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdcebb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745413:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdcead lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165554d expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745425:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838e00/0xe79af2f39bbdcec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165554d expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.745433:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:0.0:1788535955.745436:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788535955.745438:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838e00, rc 0) 00000100:00100000:0.0:1788535955.745512:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+17:12240:x1875415548370560:12345-192.168.203.13@tcp:101:bash.0 Request processed in 644us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535955.745519:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:3.0:1788535955.759046:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535955.759387:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548370816 00000100:00100000:0.0:1788535955.759408:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548370816 00000100:00100000:0.0:1788535955.759466:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:0.0:1788535955.759475:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+17:12240:x1875415548370816:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788535955.759493:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535955.759512:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdcec9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655554 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.759624:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.759638:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.759650:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.759927:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.759937:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.759944:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788535955.760397:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788535955.760515:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760525:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760544:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760575:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760581:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760588:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760594:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535955.760598:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760618:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760629:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:0.0:1788535955.760631:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535955.760636:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760642:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdced0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535955.760655:0:6533:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000971cb4db reply state 00000000f064470f transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760677:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760919:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005893b0000) 00010000:00010000:0.0:1788535955.760922:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788535955.760925:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788535955.760956:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdcec9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655554 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760970:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655554 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.760977:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9005893b0a00) 00010000:00010000:0.0:1788535955.760980:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535955.760982:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839800, rc 0) 00000100:00100000:0.0:1788535955.761052:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+20:12240:x1875415548370816:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1577us (2014us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788535955.761059:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:3.0:1788535955.768242:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535955.768396:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548370944 00000100:00100000:1.0:1788535955.768404:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548370944 00000100:00100000:1.0:1788535955.768461:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1788535955.768471:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548370944:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535955.768489:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535955.768508:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165555b expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788535955.768536:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788535955.768555:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1788535955.768559:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535955.768581:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165555b expref: 6 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.768609:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165555b expref: 6 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.768623:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fa00, rc 0) 00000100:00100000:1.0:1788535955.768681:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548370944:12345-192.168.203.13@tcp:101:bash.0 Request processed in 210us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535955.768699:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1788535955.779910:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535955.781062:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548371072 00000100:00100000:2.0:1788535955.781076:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548371072 00000100:00100000:2.0:1788535955.781253:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1788535955.781264:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+6:12240:x1875415548371072:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788535955.781294:0:10017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535955.781313:0:10017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655562 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.781347:0:10017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165555b expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.781357:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535955.781389:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535955.781396:0:10017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 7 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.781431:0:10017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165555b expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.781446:0:10017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165555b expref: 7 pid: 8448 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535955.781460:0:10017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10017:1875415569412096:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535955.781628:0:10017:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535955.786072:0:10017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10017:1875415569412096:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535955.786109:0:10017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 7 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.786130:0:10017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066a00, rc 0) 00000100:00100000:2.0:1788535955.786257:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+7:12240:x1875415548371072:12345-192.168.203.13@tcp:101:bash.0 Request processed in 4994us (6355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535955.786266:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:0.0:1788535955.788319:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535955.789308:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548371200 00000100:00100000:2.0:1788535955.789319:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548371200 00010000:00010000:2.0:1788535955.789361:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165555b expref: 7 pid: 8448 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535955.789454:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:2.0:1788535955.789465:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2401:x1875415548371200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535955.789499:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535955.789521:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165555b expref: 7 pid: 8448 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.789535:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165555b expref: 7 pid: 8448 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.789559:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdceec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165555b expref: 7 pid: 8448 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.789612:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535955.789617:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535955.789626:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 6 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.789636:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 6 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.789691:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 6 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535955.789706:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6521:1875415569412224:192.168.203.13@tcp:105: 00000100:00100000:2.0:1788535955.789948:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788535955.792408:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6521:1875415569412224:192.168.203.13@tcp:105: 00010000:00010000:2.0:1788535955.792433:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535955.792530:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2401:x1875415548371200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 3066us (4219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535955.792541:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:0.0:1788535955.795308:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535955.795405:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548371456 00000100:00100000:2.0:1788535955.795415:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548371456 00000100:00100000:2.0:1788535955.795540:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1788535955.795551:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+20:12240:x1875415548371456:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1788535955.796020:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12240:x1875415548371456:12345-192.168.203.13@tcp:35:bash.0 Request processed in 470us (719us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788535955.796044:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1788535955.870413:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535955.870988:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548371712 00000100:00100000:1.0:1788535955.870999:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548371712 00000100:00100000:1.0:1788535955.871059:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:1.0:1788535955.871070:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12250:x1875415548371712:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535955.871107:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535955.871129:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcefa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655569 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535955.871272:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788535955.871369:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcefa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655569 expref: 23 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.871384:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464900) 00010000:00010000:1.0:1788535955.871387:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535955.871393:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcefa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655569 expref: 23 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.871407:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fa00, rc 0) 00000100:00100000:1.0:1788535955.871472:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+22:12250:x1875415548371712:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 404us (1069us total) trans 4294967422 rc 301/301 00000100:00100000:1.0:1788535955.871479:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:3.0:1788535955.875005:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535955.875102:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548371968 00000100:00100000:1.0:1788535955.875111:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548371968 00000100:00100000:1.0:1788535955.875187:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:1.0:1788535955.875198:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+22:12250:x1875415548371968:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788535955.875421:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+23:12250:x1875415548371968:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 224us (425us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788535955.875429:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1788535955.945312:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535955.945416:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548372096 00000100:00100000:1.0:1788535955.945428:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548372096 00000100:00100000:1.0:1788535955.945515:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:1.0:1788535955.945526:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+23:12256:x1875415548372096:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535955.945551:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535955.945574:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcf08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655570 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.945658:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcf0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.945681:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcf0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.945703:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcf0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535955.945756:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788535955.945760:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535955.945780:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcf0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.945806:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdcf08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655570 expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.945827:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcf0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655570 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.945836:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535955.945839:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535955.945843:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fe00, rc 0) 00000100:00100000:1.0:1788535955.945908:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12256:x1875415548372096:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 384us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535955.945922:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:0.0:1788535955.951241:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.951427:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548372352 00000100:00100000:3.0:1788535955.951437:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548372352 00000100:00100000:3.0:1788535955.951528:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:3.0:1788535955.951538:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12256:x1875415548372352:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535955.951558:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535955.951578:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655577 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.951707:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.951732:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.951744:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535955.951756:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788535955.952022:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655577 expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.952041:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655577 expref: 26 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.952050:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9005893b0a00) 00010000:00010000:3.0:1788535955.952053:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535955.952056:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51400, rc 0) 00000100:00100000:3.0:1788535955.952117:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+26:12256:x1875415548372352:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 580us (885us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788535955.952136:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:3.0:1788535955.956052:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535955.956339:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548372480 00000100:00100000:0.0:1788535955.956351:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548372480 00000100:00100000:0.0:1788535955.956423:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1788535955.956433:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+26:2402:x1875415548372480:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535955.956448:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535955.956478:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655577 expref: 26 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.956520:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9005893b0a00) 00010000:00010000:0.0:1788535955.956525:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535955.956587:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+25:2402:x1875415548372480:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 155us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535955.956595:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788535955.956610:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535955.956631:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548372736 00000100:00100000:0.0:1788535955.956635:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548372736 00000100:00100000:0.0:1788535955.956658:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:0.0:1788535955.956664:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+25:12256:x1875415548372736:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535955.957045:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535955.957062:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdcf2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165557e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.957180:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdcf32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.957194:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdcf32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.957204:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdcf32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535955.957216:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788535955.957316:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdcf2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165557e expref: 28 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.957333:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdcf32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165557e expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.957352:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9005893b0a00) 00010000:00010000:0.0:1788535955.957355:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788535955.957358:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838000, rc 0) 00000100:00100000:0.0:1788535955.957411:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12256:x1875415548372736:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 745us (810us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1788535955.957417:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:3.0:1788535955.961115:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535955.961239:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548372864 00000100:00100000:1.0:1788535955.961249:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548372864 00000100:00100000:1.0:1788535955.961338:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1788535955.961348:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2400:x1875415548372864:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:1.0:1788535955.961392:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.961413:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 6 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.961422:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535955.961426:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535955.961431:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.961460:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 6 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.961470:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 6 pid: 10017 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535955.961480:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1875415569412352:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535955.961609:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535955.968040:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535955.968118:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548372992 00000100:00100000:0.0:1788535955.968127:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548372992 00002000:00100000:0.0:1788535955.968214:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9004888ded80 x1875415548372992/t0(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:611/0 lens 504/0 e 0 to 0 dl 1788535966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535955.968226:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9004888ded80 with x1875415548372992 ext(0->12) 00010000:00010000:0.0:1788535955.968236:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 7 pid: 10017 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.968253:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 7 pid: 10017 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535955.968261:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9004888ded80 00000100:00100000:0.0:1788535955.968293:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1788535955.968303:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548372992:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:1.0:1788535955.968416:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1875415569412352:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535955.968447:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535955.969975:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2402:x1875415548372992:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 1664us (1935us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788535955.969988:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:0.0:1788535955.970009:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9004888ded80 x1875415548372992/t4294967306(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:611/0 lens 504/448 e 0 to 0 dl 1788535966 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535955.970030:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9004888ded80 with x1875415548372992 ext(0->12) 00010000:00010000:0.0:1788535955.970040:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 9 pid: 10017 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535955.970056:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 9 pid: 10017 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535955.970064:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9004888ded80 00000100:00100000:0.0:1788535955.972844:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535955.973015:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548373120 00000100:00100000:1.0:1788535955.973025:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548373120 00010000:00010000:1.0:1788535955.973063:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 9 pid: 10017 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535955.973110:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1788535955.973120:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2399:x1875415548373120:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535955.973135:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788535955.973184:0:6520:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788535955.973188:0:6520:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788535956 00002000:00010000:1.0:1788535955.973190:0:6520:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788535956 00002000:00010000:1.0:1788535955.973193:0:6520:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788535956 00002000:00010000:1.0:1788535955.973195:0:6520:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788535955.973202:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 9 pid: 10017 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.973216:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 9 pid: 10017 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.973239:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ff3c81/0xe79af2f39bbdcef3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655562 expref: 9 pid: 10017 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.973255:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535955.973394:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535955.973401:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.973411:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.973486:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535955.973545:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2399:x1875415548373120:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 425us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535955.973553:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00010000:00010000:2.0:1788535955.973930:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.973941:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.973963:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.973971:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.973979:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.973986:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620fa00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788535955.973990:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.974007:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.974022:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535955.974044:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32745a1/0xe79af2f39bbdcf40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535955.974103:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2400:x1875415548372864:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 12756us (12996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535955.974110:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1788535955.976271:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535955.976365:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548373376 00000100:00100000:1.0:1788535955.976373:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548373376 00000100:00100000:1.0:1788535955.976428:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:1.0:1788535955.976438:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf17050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12256:x1875415548373376:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:1.0:1788535955.976505:0:6536:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdcf32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165557e expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535955.976912:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788535955.976958:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1788535955.977283:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:1.0:1788535955.977320:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.977340:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655554 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.977350:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.977400:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655554 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.977414:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655554 expref: 31 pid: 6533 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535955.977428:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6536:1875415569412480:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535955.977538:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535955.979421:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6536:1875415569412480:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535955.979447:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535955.979898:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.980240:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548373504 00000100:00100000:3.0:1788535955.980248:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548373504 00010000:00010000:3.0:1788535955.980283:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655554 expref: 32 pid: 6533 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535955.980323:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:3.0:1788535955.980333:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+32:2401:x1875415548373504:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535955.980347:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535955.980354:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655554 expref: 32 pid: 6533 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.980365:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655554 expref: 32 pid: 6533 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.980386:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdcede lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655554 expref: 32 pid: 6533 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.980403:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9005893b0a00) 00010000:00010000:3.0:1788535955.980407:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.980417:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.980440:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535955.980472:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535955.980539:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+31:2401:x1875415548373504:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 207us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535955.980547:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00010000:00010000:1.0:1788535955.980896:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.980905:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535955.981002:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:1.0:1788535955.981114:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788535955.981238:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1875415569412608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788535955.981286:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535955.981315:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788535955.981449:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569412608 00000100:00100000:3.0:1788535955.981454:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569412608 00000100:00100000:3.0:1788535955.981512:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788535955.981520:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6536:x1875415569412608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788535955.981593:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6536:x1875415569412608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535955.981612:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1788535955.981996:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535955.982027:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1875415569412608:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788535955.982134:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:1.0:1788535955.982249:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1875415569412736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788535955.982296:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535955.982353:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535955.982384:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569412736 00000100:00100000:3.0:1788535955.982389:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569412736 00000100:00100000:3.0:1788535955.982459:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788535955.982467:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6536:x1875415569412736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788535955.982586:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6536:x1875415569412736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 120us (289us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788535955.982593:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788535955.982655:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6536:1875415569412736:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788535955.982688:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788535955.982727:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.982737:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.982743:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.982748:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535955.982752:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.982760:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.982773:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9005893b0a00) 00010000:00010000:1.0:1788535955.982777:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788535955.982781:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.982787:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf47 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788535955.982871:0:6536:0:(mdd_object.c:4338:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788535955.982930:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788535955.982942:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414786794437ns, next at 415786792390ns, rc = 0 00000001:00080000:1.0:1788535955.982956:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:1.0:1788535955.982979:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9005893b0a00) 00010000:00010000:1.0:1788535955.982982:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788535955.982988:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdcf32 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165557e expref: 35 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535955.983088:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf17050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+34:12256:x1875415548373376:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 6650us (6822us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788535955.983096:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000020:00080000:1.0:1788535955.983100:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788535955.985395:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535955.985484:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548373632 00000100:00100000:1.0:1788535955.985493:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548373632 00000100:00100000:1.0:1788535955.985580:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:1.0:1788535955.985590:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+34:12256:x1875415548373632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535955.985620:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535955.985643:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcf4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655585 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.985722:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcf4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655585 expref: 35 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.985738:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcf4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655585 expref: 35 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535955.985756:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535955.985759:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788535955.985764:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f200, rc 0) 00000100:00100000:1.0:1788535955.985816:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+35:12256:x1875415548373632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 228us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535955.985837:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:0.0:1788535955.988227:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535955.988322:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548373888 00000100:00100000:3.0:1788535955.988331:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548373888 00000100:00100000:3.0:1788535955.988383:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1788535955.988392:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+35:12256:x1875415548373888:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788535955.988595:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+36:12256:x1875415548373888:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 203us (376us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788535955.988627:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1788535956.076272:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535956.076392:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548374144 00000100:00100000:3.0:1788535956.076404:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548374144 00000100:00100000:3.0:1788535956.076464:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:3.0:1788535956.076475:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+36:12266:x1875415548374144:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535956.076510:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535956.076539:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcf55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165558c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535956.076637:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788535956.076733:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcf55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165558c expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.076747:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464900) 00010000:00010000:3.0:1788535956.076750:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535956.076754:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcf55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165558c expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.076768:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030c00, rc 0) 00000100:00100000:3.0:1788535956.076824:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+37:12266:x1875415548374144:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 351us (561us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1788535956.076831:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:0.0:1788535956.080552:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535956.080728:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548374272 00000100:00100000:2.0:1788535956.080738:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548374272 00000100:00100000:2.0:1788535956.080798:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:2.0:1788535956.080808:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+37:12266:x1875415548374272:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788535956.080894:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.080911:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.080923:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.080935:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.080941:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.080947:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081043:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081053:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081060:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535956.081107:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081119:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081125:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081131:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081137:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535956.081141:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081192:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081204:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:2.0:1788535956.081207:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535956.081211:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081223:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcf63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081238:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081243:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081248:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081252:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535956.081255:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081260:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081268:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005893b0000) 00010000:00010000:2.0:1788535956.081270:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535956.081273:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081278:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcf6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081287:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081292:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081304:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081309:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535956.081311:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081318:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081326:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535956.081328:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535956.081331:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.081336:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdcf71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535956.081402:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+37:12266:x1875415548374272:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 594us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535956.081409:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:0.0:1788535956.084481:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535956.084676:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548374528 00000100:00100000:3.0:1788535956.084685:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548374528 00000100:00100000:3.0:1788535956.084741:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1788535956.084749:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+37:12266:x1875415548374528:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788535956.084974:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+38:12266:x1875415548374528:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 225us (500us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788535956.084981:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1788535956.129259:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535956.129658:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548374784 00000100:00100000:1.0:1788535956.129667:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548374784 00000100:00100000:3.0:1788535956.129809:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:3.0:1788535956.129823:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+38:12269:x1875415548374784:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535956.129848:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535956.129870:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcf78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655593 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.129938:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.129953:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.129965:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.129977:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.129985:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130007:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130105:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130126:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130134:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535956.130170:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788535956.130248:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130256:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130263:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130282:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535956.130287:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130295:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130307:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535956.130310:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535956.130316:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130322:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdcf7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130335:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130348:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130354:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130360:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535956.130363:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130370:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130379:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005893b0000) 00010000:00010000:3.0:1788535956.130381:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535956.130385:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130391:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdcf86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130431:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdcf78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655593 expref: 41 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130445:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655593 expref: 40 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.130453:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:3.0:1788535956.130455:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535956.130466:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51000, rc 0) 00000100:00100000:3.0:1788535956.130549:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+40:12269:x1875415548374784:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 730us (1297us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788535956.130556:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:0.0:1788535956.135813:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535956.135901:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548374912 00000100:00100000:1.0:1788535956.135909:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548374912 00000100:00100000:1.0:1788535956.135957:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:1.0:1788535956.135966:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+40:12269:x1875415548374912:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1788535956.136034:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.136050:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.136061:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.136092:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.136099:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.136105:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.136110:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535956.136115:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.136121:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.136182:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535956.136189:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535956.136194:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.136200:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcf9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535956.136278:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+40:12269:x1875415548374912:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 305us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535956.136286:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000040:00080000:0.0:1788535956.140857:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535956.140867:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535956.140969:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788535956.140976:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788535956.143807:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535956.143951:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548375168 00000100:00100000:2.0:1788535956.143961:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548375168 00000100:00100000:2.0:1788535956.144031:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1788535956.144042:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+40:12269:x1875415548375168:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788535956.144289:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+41:12269:x1875415548375168:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 247us (490us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788535956.144297:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1788535956.426944:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535956.427038:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548375424 00000100:00100000:1.0:1788535956.427048:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548375424 00000100:00100000:1.0:1788535956.427104:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:1.0:1788535956.427114:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+41:12300:x1875415548375424:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1788535956.427137:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535956.427190:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcfa2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165559a expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.427291:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcfa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.427305:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.427317:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535956.427328:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788535956.427440:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcfa2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165559a expref: 44 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.427458:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcfa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165559a expref: 43 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.427467:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535956.427470:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535956.427473:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620ec00, rc 0) 00000100:00100000:1.0:1788535956.427534:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+43:12300:x1875415548375424:12345-192.168.203.13@tcp:101:cat.0 Request processed in 421us (599us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788535956.427542:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:0.0:1788535956.432122:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535956.432241:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535956.432532:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548375552 00000100:00100000:2.0:1788535956.432541:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548375552 00000100:00100000:2.0:1788535956.432606:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1788535956.432617:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfaa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+43:2400:x1875415548375552:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535956.432632:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535956.432660:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdcfa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165559a expref: 43 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.432692:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535956.432697:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535956.432759:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfaa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+42:2400:x1875415548375552:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 144us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535956.432766:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788535956.433768:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548375808 00000100:00100000:3.0:1788535956.433779:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548375808 00000100:00100000:3.0:1788535956.433822:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1788535956.433830:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+42:12300:x1875415548375808:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:3.0:1788535956.434052:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+43:12300:x1875415548375808:12345-192.168.203.13@tcp:35:cat.0 Request processed in 222us (1809us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788535956.434059:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788535956.506392:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535956.506489:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548376064 00000100:00100000:1.0:1788535956.506498:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548376064 00000100:00100000:1.0:1788535956.506558:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:1.0:1788535956.506569:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+43:12306:x1875415548376064:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:1.0:1788535956.506593:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535956.506605:0:10016:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788535956.506630:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcf0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655570 expref: 43 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.506652:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535956.506657:0:10016:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535956.506679:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcfb7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555a1 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.506782:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.506813:0:10016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655593 expref: 43 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.506822:0:10016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.506863:0:10016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655593 expref: 43 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.506877:0:10016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655593 expref: 43 pid: 6533 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535956.506890:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569412864:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535956.506987:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788535956.509075:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569412864:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535956.509101:0:10016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535956.512994:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535956.513402:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548376192 00000100:00100000:3.0:1788535956.513412:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548376192 00010000:00010000:3.0:1788535956.513452:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655593 expref: 44 pid: 6533 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535956.513494:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:3.0:1788535956.513503:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+44:2401:x1875415548376192:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535956.513516:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535956.513523:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655593 expref: 44 pid: 6533 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.513536:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655593 expref: 44 pid: 6533 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.513556:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcf8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655593 expref: 44 pid: 6533 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.513588:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:3.0:1788535956.513604:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.513614:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.513621:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.513649:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535956.513696:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+43:2401:x1875415548376192:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 193us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535956.513702:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00010000:00010000:1.0:1788535956.513801:0:10016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.513809:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535956.513827:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788535956.513967:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcfb7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a1 expref: 44 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.513995:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a1 expref: 43 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.514003:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535956.514006:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788535956.514008:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e800, rc 0) 00000100:00100000:1.0:1788535956.514033:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+43:12306:x1875415548376064:12345-192.168.203.13@tcp:101:dd.0 Request processed in 7466us (7652us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788535956.514041:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1788535956.520922:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535956.521015:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548376320 00000100:00100000:2.0:1788535956.521025:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548376320 00000100:00100000:2.0:1788535956.521083:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:2.0:1788535956.521093:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+43:12306:x1875415548376320:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1788535956.521115:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535956.521135:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcfcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.521206:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.521221:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.521231:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.521366:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdcfcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a8 expref: 45 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.521385:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a8 expref: 44 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.521394:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535956.521397:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788535956.521401:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067600, rc 0) 00000100:00100000:2.0:1788535956.521454:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+44:12306:x1875415548376320:12345-192.168.203.13@tcp:101:dd.0 Request processed in 364us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535956.521461:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000040:00080000:2.0:1788535956.524956:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788535956.525431:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535956.526842:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548376576 00000100:00100000:3.0:1788535956.526851:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548376576 00000100:00100000:3.0:1788535956.527002:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:3.0:1788535956.527014:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+44:12306:x1875415548376576:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:3.0:1788535956.527255:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.527271:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.527282:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535956.527324:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788535956.527343:0:6533:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000c0f3ccd8 reply state 00000000ca4a56e4 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.527373:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535956.527380:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:3.0:1788535956.527383:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535956.527387:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535956.527465:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+47:12306:x1875415548376576:12345-192.168.203.13@tcp:36:dd.0 Request processed in 454us (2038us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788535956.527473:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000020:00080000:3.0:1788535956.527478:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788535956.652541:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535956.859271:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535956.859492:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548376704 00000100:00100000:1.0:1788535956.859501:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548376704 00000100:00100000:1.0:1788535956.859564:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:1.0:1788535956.859574:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+47:12320:x1875415548376704:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:1.0:1788535956.859607:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535956.859628:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcfe1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555af expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.859694:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.859709:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.859733:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.859746:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.859768:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.859776:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.860035:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.860047:0:10016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a1 expref: 48 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.860056:0:10016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.860908:0:10016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a1 expref: 48 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.860927:0:10016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a1 expref: 48 pid: 10016 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535956.860943:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569412992:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535956.861100:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788535956.867984:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569412992:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535956.868017:0:10016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535956.869743:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535956.869827:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548376960 00000100:00100000:3.0:1788535956.869835:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548376960 00000100:00100000:3.0:1788535956.869894:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1788535956.869905:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+49:6169:x1875415548376960:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788535956.870446:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+50:6169:x1875415548376960:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 540us (707us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1788535956.870455:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1788535956.875613:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535956.875975:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548377088 00000100:00100000:2.0:1788535956.875986:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548377088 00010000:00010000:2.0:1788535956.876029:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a1 expref: 50 pid: 10016 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535956.876302:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:2.0:1788535956.876313:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+50:2401:x1875415548377088:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535956.876328:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535956.876336:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a1 expref: 50 pid: 10016 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.876352:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a1 expref: 50 pid: 10016 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.876397:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdcfbe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a1 expref: 50 pid: 10016 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.876415:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535956.876420:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.876430:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.876437:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535956.876524:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535956.876601:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+49:2401:x1875415548377088:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 281us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535956.876610:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00010000:00010000:1.0:1788535956.878026:0:10016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878055:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535956.878395:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788535956.878399:0:10016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788535956.878427:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878443:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878452:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878459:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878466:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878472:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535956.878476:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878482:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878495:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535956.878497:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535956.878502:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878519:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdcfe8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878536:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878541:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878547:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878551:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535956.878554:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878559:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878567:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005893b0000) 00010000:00010000:1.0:1788535956.878569:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535956.878572:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878577:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdcfef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878620:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcfe1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555af expref: 49 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878646:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555af expref: 48 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.878653:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535956.879002:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535956.879007:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f600, rc 0) 00000100:00100000:1.0:1788535956.879088:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+48:12320:x1875415548376704:12345-192.168.203.13@tcp:101:stat.0 Request processed in 19506us (19819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535956.879098:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:0.0:1788535956.950815:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535956.954344:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548377344 00000100:00100000:1.0:1788535956.954364:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548377344 00000100:00100000:1.0:1788535956.954559:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:1.0:1788535956.954571:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+48:12326:x1875415548377344:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:1.0:1788535956.954637:0:10112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535956.954674:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdcff6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555af expref: 48 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.954696:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535956.954700:0:10112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535956.954861:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.954875:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.954884:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535956.954939:0:10112:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:1.0:1788535956.954958:0:10112:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000062a3d007 reply state 00000000fc3a6714 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.954970:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535956.954977:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535956.954979:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788535956.954982:0:10112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535956.955077:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+50:12326:x1875415548377344:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 508us (4270us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788535956.958235:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00000020:00080000:1.0:1788535956.958244:0:10112:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788535957.144336:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535957.153202:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548377472 00000100:00100000:3.0:1788535957.153217:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548377472 00000100:00100000:3.0:1788535957.153303:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:3.0:1788535957.153317:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+50:12340:x1875415548377472:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:3.0:1788535957.153340:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535957.153361:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbdd004 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555b6 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153442:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153469:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153480:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153494:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153502:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153508:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153585:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153603:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153614:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535957.153661:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788535957.153665:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788535957.153687:0:6533:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153698:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153714:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153720:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153727:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153732:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535957.153736:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153742:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153754:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535957.153757:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535957.153762:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153768:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbdd00b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153781:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153788:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153793:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153810:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535957.153815:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153821:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153829:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005893b0000) 00010000:00010000:3.0:1788535957.153833:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535957.153836:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153841:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030c00/0xe79af2f39bbdd012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153869:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbdd004 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555b6 expref: 52 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153880:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555b6 expref: 51 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.153887:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:3.0:1788535957.153890:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535957.153892:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030e00, rc 0) 00000100:00100000:3.0:1788535957.153948:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+51:12340:x1875415548377472:12345-192.168.203.13@tcp:101:stat.0 Request processed in 636us (9625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535957.153955:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00080000:1.0:1788535957.154628:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535957.235057:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535957.235220:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548377728 00000100:00100000:1.0:1788535957.235229:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548377728 00000100:00100000:1.0:1788535957.235290:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:1.0:1788535957.235302:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+51:12350:x1875415548377728:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535957.235320:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535957.235341:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555bd expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535957.235451:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788535957.235547:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd020 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555bd expref: 53 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.235562:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464900) 00010000:00010000:1.0:1788535957.235572:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535957.235579:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555bd expref: 53 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.235606:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f600, rc 0) 00000100:00100000:1.0:1788535957.235670:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+52:12350:x1875415548377728:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 371us (623us total) trans 4294967448 rc 301/301 00000100:00100000:1.0:1788535957.235677:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:3.0:1788535957.242640:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535957.242795:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548377984 00000100:00100000:2.0:1788535957.242806:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548377984 00000100:00100000:2.0:1788535957.242867:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1788535957.242878:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+52:12350:x1875415548377984:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788535957.243082:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+53:12350:x1875415548377984:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 206us (451us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788535957.243091:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1788535957.291920:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535957.292030:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548378240 00000100:00100000:1.0:1788535957.292040:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548378240 00000100:00100000:1.0:1788535957.292102:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:1.0:1788535957.292112:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+53:12356:x1875415548378240:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535957.292135:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535957.292192:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd02e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555c4 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.292287:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.292301:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555b6 expref: 54 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.292310:0:10112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.292860:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555b6 expref: 54 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.292876:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555b6 expref: 54 pid: 6533 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535957.292912:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569413120:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535957.293012:0:10112:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788535957.296441:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535957.296535:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548378368 00000100:00100000:0.0:1788535957.296543:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548378368 00010000:00010000:0.0:1788535957.296580:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555b6 expref: 55 pid: 6533 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535957.296727:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048821d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569413120:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535957.296751:0:10112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535957.298856:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1788535957.298880:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+55:2401:x1875415548378368:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535957.298898:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535957.298908:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555b6 expref: 55 pid: 6533 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.298925:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555b6 expref: 55 pid: 6533 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.298948:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900580030e00/0xe79af2f39bbdd019 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555b6 expref: 55 pid: 6533 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.298966:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:0.0:1788535957.298986:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.298996:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.299004:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.299027:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535957.299095:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+54:2401:x1875415548378368:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 227us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.299103:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00010000:00010000:1.0:1788535957.299179:0:10112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.299186:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535957.299204:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788535957.299324:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd02e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555c4 expref: 55 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.299340:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555c4 expref: 54 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.299348:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535957.299350:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788535957.299353:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f800, rc 0) 00000100:00100000:1.0:1788535957.299377:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+54:12356:x1875415548378240:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7268us (7467us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788535957.299384:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:3.0:1788535957.307899:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535957.308187:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548378624 00000100:00100000:2.0:1788535957.308196:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548378624 00000100:00100000:2.0:1788535957.308245:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:2.0:1788535957.308269:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+54:12356:x1875415548378624:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:2.0:1788535957.308494:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.308512:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.308524:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535957.308563:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:2.0:1788535957.308583:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000000ecf55cf reply state 0000000040842f9b transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.308606:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.308614:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535957.308617:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788535957.308620:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788535957.308718:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+57:12356:x1875415548378624:12345-192.168.203.13@tcp:36:bash.0 Request processed in 449us (827us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788535957.308725:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 176 00000020:00080000:2.0:1788535957.308730:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788535957.317106:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535957.317266:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548378752 00000100:00100000:2.0:1788535957.317275:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548378752 00000100:00100000:2.0:1788535957.317333:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:2.0:1788535957.317342:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+57:12356:x1875415548378752:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788535957.317366:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535957.317387:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd04a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555cb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.317489:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.317504:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555c4 expref: 58 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.317513:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.317543:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555c4 expref: 58 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.317556:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555c4 expref: 58 pid: 10112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535957.317568:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569413248:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535957.317698:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788535957.321271:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535957.321505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548378880 00000100:00100000:0.0:1788535957.321514:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548378880 00010000:00010000:0.0:1788535957.321550:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555c4 expref: 59 pid: 10112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535957.321587:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:0.0:1788535957.321605:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+59:2401:x1875415548378880:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535957.321620:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535957.321627:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555c4 expref: 59 pid: 10112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.321640:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555c4 expref: 59 pid: 10112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.321674:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:0.0:1788535957.321679:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.321712:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.321721:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.321741:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535957.322039:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+59:2401:x1875415548378880:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 434us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.322047:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00010000:00010000:2.0:1788535957.322726:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd035 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555c4 expref: 58 pid: 10112 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535957.322747:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875415569413248:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535957.322767:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.323008:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.323027:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535957.323079:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788535957.323084:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788535957.323313:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.323348:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd04a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555cb expref: 58 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.323364:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555cb expref: 57 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.323374:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535957.323377:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535957.323379:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066a00, rc 0) 00000100:00100000:2.0:1788535957.323432:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+57:12356:x1875415548378752:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6090us (6345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535957.323440:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:3.0:1788535957.329032:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535957.329955:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548379136 00000100:00100000:2.0:1788535957.329965:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548379136 00000100:00100000:2.0:1788535957.330065:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1788535957.330075:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+57:12356:x1875415548379136:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1788535957.330297:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+58:12356:x1875415548379136:12345-192.168.203.13@tcp:35:bash.0 Request processed in 222us (1274us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788535957.330306:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1788535957.403396:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535957.406224:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548379392 00000100:00100000:1.0:1788535957.406257:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548379392 00000100:00100000:1.0:1788535957.406403:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:1.0:1788535957.406415:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+58:12366:x1875415548379392:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535957.406440:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535957.406459:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555d2 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535957.406574:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788535957.406685:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd058 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555d2 expref: 60 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.406711:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464900) 00010000:00010000:1.0:1788535957.406714:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535957.406719:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555d2 expref: 60 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.406734:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fe00, rc 0) 00000100:00100000:1.0:1788535957.406807:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+59:12366:x1875415548379392:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 395us (3431us total) trans 4294967454 rc 301/301 00000100:00100000:1.0:1788535957.406814:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:3.0:1788535957.409981:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535957.410286:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548379520 00000100:00100000:1.0:1788535957.410295:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548379520 00000100:00100000:1.0:1788535957.410354:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:1.0:1788535957.410365:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+59:12366:x1875415548379520:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1788535957.410433:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410451:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410478:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410490:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410498:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410505:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410574:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410584:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410601:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535957.410649:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410671:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410679:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410685:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410767:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620ee00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535957.410772:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410781:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410793:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535957.410796:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535957.410800:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410805:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd066 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410819:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410825:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410832:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410837:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535957.410839:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410845:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410972:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005893b0000) 00010000:00010000:1.0:1788535957.410976:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535957.410981:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410988:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd06d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.410999:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.411005:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.411011:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.411016:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535957.411019:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.411025:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.411033:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535957.411035:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535957.411038:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.411043:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd074 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535957.411551:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+59:12366:x1875415548379520:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1183us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535957.411561:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:3.0:1788535957.413634:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535957.413722:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548379776 00000100:00100000:1.0:1788535957.413730:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548379776 00000100:00100000:1.0:1788535957.413782:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1788535957.413793:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+59:12366:x1875415548379776:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788535957.414421:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+60:12366:x1875415548379776:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 626us (794us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788535957.414430:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1788535957.420618:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535957.422798:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569413504:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.422887:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535957.423016:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569413376:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.423074:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535957.423490:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569413632:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.423524:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535957.423546:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569414144:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.423568:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535957.423633:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569413376 00000100:00100000:0.0:1788535957.423640:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569413376 00000100:00100000:0.0:1788535957.423694:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788535957.423704:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569413376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.423749:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569413376:12345-0@lo:400:kworker.0 Request processed in 47us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.423756:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788535957.423888:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569413632 00000100:00100000:0.0:1788535957.423893:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569413632 00000100:00100000:0.0:1788535957.423921:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788535957.423928:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569413632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.423963:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569413632:12345-0@lo:400:kworker.0 Request processed in 35us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.423969:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788535957.423989:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569413888:0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.424013:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535957.424043:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569414400:0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.424067:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535957.424285:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569414912:0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.424312:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535957.424333:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788535957.424339:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569414016:0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.424376:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569413888 00000100:00100000:0.0:1788535957.424380:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569413888 00000100:00100000:0.0:1788535957.424400:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788535957.424405:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569413888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.424441:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569413888:12345-0@lo:400:kworker.0 Request processed in 35us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.424446:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788535957.424476:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569414400 00000100:00100000:0.0:1788535957.424479:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569414400 00000100:00100000:0.0:1788535957.424507:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569414912 00000100:00100000:0.0:1788535957.424511:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569414912 00000100:00100000:0.0:1788535957.424532:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788535957.424539:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569414400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.424575:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569414400:12345-0@lo:400:kworker.0 Request processed in 37us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.424581:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788535957.424603:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788535957.424610:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569414912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535957.424638:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569414912:12345-0@lo:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.424645:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788535957.424679:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569413760:0@lo:400:kworker.0 00000100:00080000:1.0:1788535957.424931:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535957.424936:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535957.424962:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569413376:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.432280:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569414656:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.432344:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535957.433803:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569413504 00000100:00100000:3.0:1788535957.433814:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569413504 00000100:00100000:3.0:1788535957.433907:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569414144 00000100:00100000:3.0:1788535957.433911:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569414144 00000100:00080000:1.0:1788535957.433942:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788535957.433952:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788535957.433963:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569413504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.433964:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788535957.433981:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569414144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.434046:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569414144:12345-0@lo:400:kworker.0 Request processed in 71us (10476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535957.434056:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788535957.434069:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569413504:12345-0@lo:400:kworker.0 Request processed in 94us (11167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535957.434084:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788535957.434135:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569413504:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.438709:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569413632:0@lo:400:kworker.0 00010000:00080000:2.0:1788535957.438729:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048891fb80 x1875415569414144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535957.438740:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569414144:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.439803:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535957.439846:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569414656 00000100:00100000:2.0:1788535957.439856:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569414656 00000100:00100000:1.0:1788535957.439879:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569414528:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.439923:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569414016 00000100:00100000:2.0:1788535957.439928:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569414016 00000100:00100000:1.0:1788535957.439933:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535957.439950:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569414528 00000100:00100000:2.0:1788535957.439954:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569414528 00000100:00100000:1.0:1788535957.439974:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569413888:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.439979:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788535957.439990:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569414656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.440004:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569414400:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.440018:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569414912:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.440050:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569414656:12345-0@lo:400:kworker.0 Request processed in 61us (7704us total) trans 0 rc 0/0 00000100:00080000:1.0:1788535957.440058:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535957.440063:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535957.440070:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788535957.440078:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788535957.440100:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569414016:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788535957.440106:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488920000 x1875415569414656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535957.440120:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569414656:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.440167:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569414016:12345-0@lo:400:kworker.0 Request processed in 59us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535957.440171:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788535957.440195:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569414528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535957.440224:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535957.440234:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569414528:12345-0@lo:400:kworker.0 Request processed in 40us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535957.440251:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569414272:0@lo:400:kworker.0 00000100:00100000:3.0:1788535957.440289:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535957.440317:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569414784:0@lo:400:kworker.0 00000100:00100000:3.0:1788535957.440340:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535957.440673:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569413760 00000100:00100000:3.0:1788535957.440679:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569413760 00000100:00100000:1.0:1788535957.442210:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788535957.442287:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569414016:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.442302:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569414528:0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.443294:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569414272 00000100:00100000:1.0:1788535957.443303:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569414272 00000100:00100000:1.0:1788535957.443360:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569414784 00000100:00100000:1.0:1788535957.443363:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569414784 00000100:00100000:1.0:1788535957.443387:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788535957.443395:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569414272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.443489:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569414272:12345-0@lo:400:kworker.0 Request processed in 95us (3199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535957.443513:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788535957.443528:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788535957.443534:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569414784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535957.443566:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569414784:12345-0@lo:400:kworker.0 Request processed in 32us (3225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535957.443571:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1788535957.443602:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788535957.443606:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535957.443895:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788535957.443959:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569414272:0@lo:400:kworker.0 00000100:00100000:2.0:1788535957.443971:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569414784:0@lo:400:kworker.0 00000100:00100000:3.0:1788535957.446772:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788535957.446792:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569413760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535957.447028:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569413760:12345-0@lo:400:kworker.0 Request processed in 244us (6804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535957.447048:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788535957.447215:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569413760:0@lo:400:kworker.0 00000100:00100000:3.0:1788535957.451086:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535957.451352:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548380032 00000100:00100000:0.0:1788535957.451363:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548380032 00000100:00100000:0.0:1788535957.451459:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:0.0:1788535957.451470:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+60:12369:x1875415548380032:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535957.451493:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535957.451526:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd07b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555d9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.451618:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.451633:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.451644:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.451654:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.451660:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.451665:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.451767:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd090 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.451776:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.451796:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535957.451807:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788535957.452065:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452073:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452079:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452085:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535957.452089:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452095:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452106:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:0.0:1788535957.452109:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535957.452113:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452119:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838200/0xe79af2f39bbdd082 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452132:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452137:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452191:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452196:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535957.452199:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452205:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452213:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005893b0000) 00010000:00010000:0.0:1788535957.452216:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535957.452219:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452224:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd089 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452261:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd07b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555d9 expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452275:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555d9 expref: 62 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.452282:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:0.0:1788535957.452284:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535957.452287:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839c00, rc 0) 00000100:00100000:0.0:1788535957.452358:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+62:12369:x1875415548380032:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 889us (1280us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788535957.452375:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:3.0:1788535957.455057:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535957.455116:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535957.456310:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548380160 00000100:00100000:2.0:1788535957.456322:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548380160 00000100:00100000:2.0:1788535957.456386:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:2.0:1788535957.456395:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+62:12369:x1875415548380160:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788535957.456456:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.456472:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.456483:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.456514:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.456521:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.456528:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.456547:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535957.456551:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.456559:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.456571:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535957.456573:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788535957.456578:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.456585:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd09e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535957.456663:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+62:12369:x1875415548380160:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 269us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535957.456671:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:2.0:1788535957.459243:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535957.459364:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548380544 00000100:00100000:3.0:1788535957.459372:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548380544 00000100:00100000:3.0:1788535957.459418:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1788535957.459427:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+62:12369:x1875415548380544:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788535957.459622:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+63:12369:x1875415548380544:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 195us (388us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788535957.459630:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:0.0:1788535957.459916:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548380288 00000100:00100000:0.0:1788535957.459920:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548380288 00000100:00100000:1.0:1788535957.462197:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788535957.462210:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+63:2401:x1875415548380288:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535957.462227:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535957.462252:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd090 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555d9 expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.462272:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535957.462276:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535957.462329:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+62:2401:x1875415548380288:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 122us (7212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535957.462336:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788535957.634283:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535957.634395:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548380800 00000100:00100000:1.0:1788535957.634404:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548380800 00000100:00100000:1.0:1788535957.634467:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:1.0:1788535957.634477:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+62:12387:x1875415548380800:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1788535957.634500:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535957.634521:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd0a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555e0 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.634648:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd0ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.634663:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.634674:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535957.634686:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788535957.634782:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd0a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555e0 expref: 65 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.634800:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd0ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555e0 expref: 64 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.634809:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535957.634812:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788535957.634815:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620ee00, rc 0) 00000100:00100000:1.0:1788535957.634874:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+64:12387:x1875415548380800:12345-192.168.203.13@tcp:101:cat.0 Request processed in 398us (601us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788535957.634881:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:3.0:1788535957.668820:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535957.668913:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548380928 00000100:00100000:0.0:1788535957.668934:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548380928 00000100:00100000:0.0:1788535957.669235:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:0.0:1788535957.669247:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+64:12388:x1875415548380928:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535957.669269:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535957.669288:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd0ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.669349:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd0c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.669363:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.669374:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535957.669413:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788535957.669418:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535957.669435:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.669459:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd0ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555e7 expref: 66 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.669477:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd0c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555e7 expref: 65 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.669498:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:0.0:1788535957.669501:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535957.669505:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838c00, rc 0) 00000100:00100000:0.0:1788535957.669566:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+65:12388:x1875415548380928:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 321us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.669573:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:2.0:1788535957.673660:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535957.675858:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548381312 00000100:00100000:3.0:1788535957.675872:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548381312 00000100:00100000:3.0:1788535957.675930:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1788535957.675940:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+65:12388:x1875415548381312:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1788535957.676627:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12388:x1875415548381312:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 684us (2973us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788535957.676636:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00010000:00010000:0.0:1788535957.677967:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535957.680732:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535957.682753:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548381440 00000100:00100000:0.0:1788535957.682777:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548381440 00000100:00100000:0.0:1788535957.682869:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:0.0:1788535957.682879:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12388:x1875415548381440:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:0.0:1788535957.682894:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788535957.682919:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd051 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555cb expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.682944:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd0ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555e0 expref: 65 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.682958:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdcf4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655585 expref: 64 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.682969:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:0.0:1788535957.682974:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535957.683047:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+63:12388:x1875415548381440:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 169us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535957.683072:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1788535957.689217:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535957.689305:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548381568 00000100:00100000:3.0:1788535957.689315:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548381568 00000100:00100000:3.0:1788535957.689373:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:3.0:1788535957.689383:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+63:12388:x1875415548381568:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:3.0:1788535957.689510:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.689533:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.689546:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788535957.689784:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788535957.690051:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+63:12388:x1875415548381568:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 665us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535957.690060:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:2.0:1788535957.722722:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535957.722878:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548381696 00000100:00100000:3.0:1788535957.722888:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548381696 00000100:00100000:3.0:1788535957.722945:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:3.0:1788535957.722955:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+63:12390:x1875415548381696:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535957.722973:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535957.722993:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd0cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723058:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723072:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723083:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723093:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723119:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723127:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723230:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723240:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723246:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535957.723284:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788535957.723288:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788535957.723305:0:6533:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723316:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723325:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723331:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723337:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723351:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632ea00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535957.723356:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723363:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723374:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535957.723377:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535957.723381:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723388:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd0d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723401:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723407:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723412:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723416:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535957.723418:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723424:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723440:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005893b0000) 00010000:00010000:3.0:1788535957.723442:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535957.723450:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723456:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd0dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723482:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd0cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555ee expref: 65 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723493:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555ee expref: 64 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535957.723499:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:3.0:1788535957.723501:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788535957.723503:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632f000, rc 0) 00000100:00100000:3.0:1788535957.723564:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+64:12390:x1875415548381696:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 610us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535957.723572:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:3.0:1788535957.939857:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535957.939879:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004881ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569415040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535957.939939:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535957.940005:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004881af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569415168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535957.940026:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535957.940055:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569415040 00000100:00100000:3.0:1788535957.940061:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569415040 00000100:00100000:3.0:1788535957.940109:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569415168 00000100:00100000:3.0:1788535957.940112:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569415168 00000100:00100000:3.0:1788535957.940125:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788535957.940132:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569415040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535957.940175:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788535957.940225:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569415040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535957.940232:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788535957.940247:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788535957.940252:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569415168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535957.940261:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788535957.940283:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569415168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535957.940288:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788535957.940327:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004881af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569415168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535957.940351:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004881ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569415040:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788535957.949364:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1788535957.949423:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:2.0:1788535957.949608:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949620:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949628:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788535957.949641:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff900487b3b780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788535957.949645:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90058934b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff900487b3b300 00000020:00080000:1.0:1788535957.949657:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90058934b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90059e40fc00 00010000:00010000:2.0:1788535957.949739:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535957.949745:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949753:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949774:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff900487807200) 00010000:00010000:2.0:1788535957.949777:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535957.949781:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949788:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbdce91 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949809:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949815:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949821:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949826:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535957.949828:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949834:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949853:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:2.0:1788535957.949855:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535957.949858:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949864:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbdce98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949881:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949889:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949894:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949900:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535957.949902:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949908:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949916:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005893b0000) 00010000:00010000:2.0:1788535957.949918:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535957.949921:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949927:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdced7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949955:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949976:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949983:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949989:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535957.949992:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.949999:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950007:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535957.950009:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535957.950012:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950018:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbdcfda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950028:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950034:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950040:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950051:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535957.950055:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950061:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950070:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535957.950073:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535957.950076:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950082:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdcffd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950094:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950100:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950106:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950111:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535957.950114:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950119:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950138:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:2.0:1788535957.950140:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535957.950143:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535957.950181:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd043 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788535957.950198:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788535957.950252:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788535957.953006:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569415296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788535957.953089:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535957.954803:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569415296 00000100:00100000:1.0:1788535957.954816:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569415296 00000100:00100000:1.0:1788535957.954872:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788535957.954882:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1875415569415296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788535957.954912:0:8446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1788535957.954945:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ae494, atime: 0x6a9ae494, ctime: 0x6a9ae494, blocks: 0x8 00010000:00010000:1.0:1788535957.954952:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.954976:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788535957.954981:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535957.954987:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.955003:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.955013:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.955021:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535957.955044:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788535957.956043:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535957.956052:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.956062:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788535957.956066:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.956075:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.956094:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.956101:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098fed322/0xe79af2f39bbdd0eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535957.956121:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535957.956124:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535957.956125:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535957.956889:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3661:x1875415569415296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2005us (3795us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788535957.956906:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:0.0:1788535957.958397:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90058ad0d180/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788535957.958410:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569415296:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1788535958.191282:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535958.191290:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535958.191311:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788535958.191320:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535958.191441:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad6c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569415424:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788535958.191526:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788535958.197230:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.197562:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548381824 00000100:00100000:0.0:1788535958.197593:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548381824 00000100:00100000:0.0:1788535958.197654:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:0.0:1788535958.197663:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12401:x1875415548381824:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788535958.197693:0:6534:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788535958.197795:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12401:x1875415548381824:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 133us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535958.197803:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:0.0:1788535958.197919:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad6c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569415424:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788535958.202638:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.202694:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548381952 00000100:00100000:0.0:1788535958.202705:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548381952 00000100:00100000:0.0:1788535958.202762:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:0.0:1788535958.202772:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+17:12401:x1875415548381952:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788535958.202841:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.202857:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.202870:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.202929:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.202936:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.202943:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.202990:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.203000:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.203006:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535958.203045:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788535958.203049:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535958.203061:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.203071:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.203078:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.203085:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.203090:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535958.203094:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.203102:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.203112:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:0.0:1788535958.203122:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535958.203127:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.203134:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd0f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204266:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204278:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204284:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204290:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535958.204294:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204300:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204312:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9005893b0100) 00010000:00010000:0.0:1788535958.204315:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535958.204318:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204324:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd0f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204342:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204354:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204359:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204364:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535958.204367:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204374:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204382:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:0.0:1788535958.204384:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535958.204387:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.204393:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd100 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535958.204472:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+17:12401:x1875415548381952:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 1699us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535958.204481:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:0.0:1788535958.218516:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.218629:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548382208 00000100:00100000:0.0:1788535958.218639:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548382208 00000100:00100000:0.0:1788535958.218683:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:0.0:1788535958.218692:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+17:12401:x1875415548382208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535958.218720:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535958.218740:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd107 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555f5 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.218837:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.218852:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.218863:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535958.218873:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788535958.218942:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.218950:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.218956:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.218962:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535958.218966:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.218974:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.218986:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:0.0:1788535958.218994:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535958.219000:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.219006:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd10e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.219047:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd107 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555f5 expref: 19 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.219056:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:0.0:1788535958.219058:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535958.219062:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd107 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555f5 expref: 19 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.219071:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838000, rc 0) 00000100:00100000:0.0:1788535958.219125:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12401:x1875415548382208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 435us (618us total) trans 4294967460 rc 301/301 00000100:00100000:0.0:1788535958.219133:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1788535958.228096:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.228434:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548382336 00000100:00100000:0.0:1788535958.228444:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548382336 00000100:00100000:0.0:1788535958.228495:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:0.0:1788535958.228504:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12401:x1875415548382336:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788535958.228602:0:10112:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788535958.228732:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12401:x1875415548382336:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 228us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535958.228740:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:0.0:1788535958.240505:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.240663:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548382592 00000100:00100000:3.0:1788535958.240672:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548382592 00000100:00100000:3.0:1788535958.240729:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:3.0:1788535958.240739:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12401:x1875415548382592:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535958.240759:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535958.240763:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788535958.240787:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd0c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555e7 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.240819:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535958.240824:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535958.240840:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd11c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16555fc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535958.241543:0:6535:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788535958.241826:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd123 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.241840:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.241851:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.241909:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd11c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555fc expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.241926:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd123 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555fc expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.241934:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff900487807d00) 00010000:00010000:3.0:1788535958.241937:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535958.241940:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632f400, rc 0) 00000100:00100000:3.0:1788535958.242049:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+19:12401:x1875415548382592:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1310us (1553us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788535958.242057:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:2.0:1788535958.260725:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.262313:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548382848 00000100:00100000:1.0:1788535958.262326:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548382848 00000100:00100000:1.0:1788535958.262386:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:1.0:1788535958.262395:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:12401:x1875415548382848:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788535958.262448:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535958.262475:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd123 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555fc expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262494:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff900487807d00) 00010000:00010000:1.0:1788535958.262504:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535958.262537:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262549:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262559:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262573:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262580:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262596:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262637:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262655:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262662:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262667:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535958.262671:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262678:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262687:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535958.262690:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535958.262704:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262712:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd131 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262723:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262728:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262734:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262739:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535958.262748:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262755:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262763:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc372297f (ffff9005b7b03d00) 00010000:00010000:1.0:1788535958.262766:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535958.262769:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.262775:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd138 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc372297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535958.262867:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12401:x1875415548382848:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 471us (2151us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788535958.262875:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:0.0:1788535958.267402:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.268031:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548382976 00000100:00100000:3.0:1788535958.268042:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548382976 00000100:00100000:3.0:1788535958.268109:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:3.0:1788535958.268121:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12401:x1875415548382976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535958.268142:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535958.268783:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd13f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655603 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.268823:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.268835:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.268845:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.268941:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd13f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655603 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.268983:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655603 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.268992:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:1.0:1788535958.268995:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788535958.268998:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fe00, rc 0) 00000100:00100000:1.0:1788535958.269061:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+19:12401:x1875415548382976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 944us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535958.269068:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:1.0:1788535958.273595:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.273910:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548383232 00000100:00100000:3.0:1788535958.273919:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548383232 00000100:00100000:3.0:1788535958.273979:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:3.0:1788535958.273991:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+19:12401:x1875415548383232:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788535958.274068:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.274084:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.274095:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788535958.274507:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788535958.274517:0:6535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417078369881ns, next at 418078367872ns, rc = 0 00000004:00010000:3.0:1788535958.274768:0:6535:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 0000000000a84a19 reply state 00000000a6b5d689 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.274783:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.274791:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:3.0:1788535958.274794:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788535958.274798:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535958.274946:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12401:x1875415548383232:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 956us (1371us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788535958.274961:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:1.0:1788535958.282903:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535958.282968:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548383360 00000100:00100000:2.0:1788535958.282977:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548383360 00000100:00100000:2.0:1788535958.283039:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:2.0:1788535958.283049:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12401:x1875415548383360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535958.283070:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535958.283091:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165560a expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.283186:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165560a expref: 22 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.283201:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165560a expref: 22 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.283221:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:2.0:1788535958.283224:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535958.283227:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066600, rc 0) 00000100:00100000:2.0:1788535958.283281:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+22:12401:x1875415548383360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 234us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535958.283287:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1788535958.292823:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.293889:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548383488 00000100:00100000:0.0:1788535958.293903:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548383488 00000100:00100000:0.0:1788535958.299292:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:0.0:1788535958.299312:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+6:2402:x1875415548383488:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788535958.299561:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548383488:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 256us (6747us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788535958.299569:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00080000:1.0:1788535958.300317:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535958.310862:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.310985:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548383744 00000100:00100000:1.0:1788535958.310995:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548383744 00000100:00100000:1.0:1788535958.311099:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1788535958.311111:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+22:12401:x1875415548383744:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788535958.311349:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+23:12401:x1875415548383744:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 241us (496us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788535958.311356:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1788535958.316030:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.316283:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548384000 00000100:00100000:1.0:1788535958.316293:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548384000 00000100:00100000:1.0:1788535958.316387:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:1.0:1788535958.316398:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+23:12401:x1875415548384000:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788535958.316510:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+23:12401:x1875415548384000:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 113us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535958.316530:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:0.0:1788535958.324305:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.326715:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548384128 00000100:00100000:3.0:1788535958.326892:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548384128 00000100:00100000:2.0:1788535958.327054:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:2.0:1788535958.327066:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+23:12401:x1875415548384128:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788535958.327086:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535958.327107:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067a00/0xe79af2f39bbdd15b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655611 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.327192:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd162 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.327207:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.327219:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535958.327281:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788535958.327304:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.327356:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067a00/0xe79af2f39bbdd15b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655611 expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.327375:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655611 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.327384:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:2.0:1788535958.327387:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788535958.327392:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067000, rc 0) 00000100:00100000:2.0:1788535958.327468:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12401:x1875415548384128:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 404us (3172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535958.327476:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:2.0:1788535958.334408:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.334487:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548384256 00000100:00100000:1.0:1788535958.334497:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548384256 00000100:00100000:1.0:1788535958.334559:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1788535958.334569:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2401:x1875415548384256:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535958.334598:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535958.334620:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655618 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788535958.334647:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae496, blocks: 0x0 00010000:00010000:1.0:1788535958.334669:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788535958.334674:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535958.334683:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655618 expref: 8 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.334714:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655618 expref: 8 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.334735:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f000, rc 0) 00000100:00100000:1.0:1788535958.334796:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548384256:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 228us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535958.334803:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1788535958.337667:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535958.337741:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548384512 00000100:00100000:2.0:1788535958.337750:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548384512 00000100:00100000:2.0:1788535958.337807:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:2.0:1788535958.337817:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12401:x1875415548384512:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788535958.337908:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12401:x1875415548384512:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 93us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535958.337916:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:3.0:1788535958.341359:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.341507:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548384640 00000100:00100000:0.0:1788535958.341517:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548384640 00000100:00100000:0.0:1788535958.341568:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788535958.341577:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:12401:x1875415548384640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535958.341601:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535958.341618:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165561f expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.341645:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655618 expref: 9 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.341653:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535958.341657:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535958.341663:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.341693:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655618 expref: 9 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.341720:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655618 expref: 9 pid: 8447 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535958.341734:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8448:1875415569415552:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535958.341803:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff900590741cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788535958.345215:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.345337:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548384768 00000100:00100000:1.0:1788535958.345345:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548384768 00010000:00010000:1.0:1788535958.345392:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655618 expref: 10 pid: 8447 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535958.345441:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:1.0:1788535958.345451:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059bfaa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+10:2402:x1875415548384768:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535958.345466:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535958.345486:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655618 expref: 10 pid: 8447 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.345499:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655618 expref: 10 pid: 8447 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.345521:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535958.345526:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535958.345533:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 10 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.345543:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 10 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.345574:0:10351:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 10 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535958.345596:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10351:1875415569415680:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788535958.345668:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3be40 going to sleep for 11 seconds 00010000:00010000:0.0:1788535958.345898:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006719d6ae/0xe79af2f39bbdd169 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655618 expref: 10 pid: 8447 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535958.345914:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8448:1875415569415552:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535958.345934:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.345943:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839000, rc 0) 00000100:00100000:0.0:1788535958.345979:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+9:12401:x1875415548384640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 4402us (4628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535958.345986:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1788535958.349901:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10351:1875415569415680:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788535958.349944:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535958.350289:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059bfaa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2402:x1875415548384768:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4837us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535958.350300:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:1.0:1788535958.356329:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.356411:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548384896 00000100:00100000:3.0:1788535958.356419:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548384896 00002000:00100000:3.0:1788535958.356467:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90048891ca80 x1875415548384896/t0(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:614/0 lens 504/0 e 0 to 0 dl 1788535969 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535958.356476:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90048891ca80 with x1875415548384896 ext(0->8) 00002000:00010000:3.0:1788535958.356482:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90048891ca80 00000100:00100000:3.0:1788535958.356514:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1788535958.356523:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548384896:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788535958.357601:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+10:2401:x1875415548384896:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 1074us (1275us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788535958.357611:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00002000:00100000:3.0:1788535958.357619:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90048891ca80 x1875415548384896/t4294967315(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:614/0 lens 504/448 e 0 to 0 dl 1788535969 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788535958.357628:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90048891ca80 with x1875415548384896 ext(0->8) 00002000:00010000:3.0:1788535958.357633:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90048891ca80 00000100:00100000:2.0:1788535958.365380:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.365494:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548385024 00000100:00100000:3.0:1788535958.365505:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548385024 00000100:00100000:3.0:1788535958.365561:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:3.0:1788535958.365573:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048896b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12401:x1875415548385024:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788535958.372318:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:0.0:1788535958.372336:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:3.0:1788535958.372417:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.372431:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.372439:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.372445:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535958.372450:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.372458:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.372475:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:3.0:1788535958.372478:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788535958.372483:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.372489:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd14d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.376848:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569415808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788535958.376916:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535958.377223:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569415808 00000100:00100000:2.0:1788535958.377240:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569415808 00000100:00100000:2.0:1788535958.377290:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788535958.377299:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569415808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788535958.377410:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788535958.377414:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788535958 00002000:00010000:2.0:1788535958.377416:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788535958.377418:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788535958 -> 1788535958 00002000:00010000:2.0:1788535958.377420:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788535958.377464:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569415808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (547us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788535958.377471:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1788535958.377552:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff900488968e00/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788535958.377559:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569415808:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1788535958.378196:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788535958.378273:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788535958.378284:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788535958.378382:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048896b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+19:12401:x1875415548385024:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 12810us (13011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535958.378396:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:0.0:1788535958.386612:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.386682:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548385152 00000100:00100000:3.0:1788535958.386691:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548385152 00000100:00100000:3.0:1788535958.386756:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1788535958.386768:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+10:2401:x1875415548385152:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788535958.392545:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1788535958.392559:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1788535958.399667:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2401:x1875415548385152:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 12891us (13053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535958.399682:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1788535958.415439:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.415478:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548385408 00000100:00100000:0.0:1788535958.415488:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548385408 00000100:00100000:0.0:1788535958.415539:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:0.0:1788535958.415554:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+19:12401:x1875415548385408:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788535958.415613:0:10112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535958.415636:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd162 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655611 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.415652:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:0.0:1788535958.415664:0:10112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535958.415689:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.415709:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.415718:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535958.416105:0:10112:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000f5b6eb26 reply state 00000000d6d1f0b6 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.416118:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.416124:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:0.0:1788535958.416127:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788535958.416130:0:10112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788535958.416230:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+20:12401:x1875415548385408:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 677us (799us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1788535958.416238:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:0.0:1788535958.422061:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.422493:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548385536 00000100:00100000:1.0:1788535958.422502:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548385536 00000100:00100000:1.0:1788535958.422601:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1788535958.422612:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2401:x1875415548385536:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788535958.422798:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788535958.422801:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788535958 -> 1788535957 00002000:00010000:1.0:1788535958.422804:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788535956 00002000:00010000:1.0:1788535958.422806:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788535958 -> 1788535957 00002000:00010000:1.0:1788535958.422808:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788535958.422869:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548385536:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 258us (814us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788535958.422877:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1788535958.427819:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.428015:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548385792 00000100:00100000:1.0:1788535958.428024:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548385792 00000100:00100000:1.0:1788535958.428098:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:1.0:1788535958.428109:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+20:12401:x1875415548385792:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788535958.428196:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.428215:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655603 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.428236:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.428273:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655603 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.428287:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655603 expref: 20 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535958.428301:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875415569415936:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535958.428391:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788535958.437034:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875415569415936:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535958.437051:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:3.0:1788535958.437071:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535958.438163:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548385920 00000100:00100000:0.0:1788535958.438172:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548385920 00010000:00010000:0.0:1788535958.438214:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655603 expref: 21 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535958.438257:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:0.0:1788535958.438267:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+21:2401:x1875415548385920:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535958.438281:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535958.438288:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655603 expref: 21 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.438301:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655603 expref: 21 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.438323:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd146 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655603 expref: 21 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.438338:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:0.0:1788535958.438343:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.438353:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.438361:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.438389:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535958.438439:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+20:2401:x1875415548385920:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 174us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535958.438459:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00010000:00010000:3.0:1788535958.438462:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.438469:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.438506:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.438513:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.438519:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.438525:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535958.438529:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.438542:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.438551:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:3.0:1788535958.438554:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788535958.438557:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.438562:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd17e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.438613:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:12401:x1875415548385792:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 10507us (10806us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788535958.438620:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:0.0:1788535958.442788:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.443005:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548386048 00000100:00100000:3.0:1788535958.443015:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548386048 00000100:00100000:3.0:1788535958.443073:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:3.0:1788535958.443083:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2402:x1875415548386048:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788535958.443130:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.443171:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.443181:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535958.443186:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535958.443191:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.443243:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.443258:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 8 pid: 8448 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.443274:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004881adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8448:1875415569416064:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535958.443357:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058ddab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535958.456677:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.456832:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004881adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8448:1875415569416064:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535958.456915:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535958.457284:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548386176 00000100:00100000:2.0:1788535958.457292:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548386176 00010000:00010000:2.0:1788535958.457329:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 9 pid: 8448 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535958.457412:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:2.0:1788535958.457422:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2401:x1875415548386176:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535958.457436:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535958.457459:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 9 pid: 8448 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.457473:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 9 pid: 8448 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.457507:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fb5ff40/0xe79af2f39bbdd170 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165561f expref: 9 pid: 8448 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.457522:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788535958.457526:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788535958.457532:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.457542:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.457573:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535958.457640:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548386176:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 219us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535958.457649:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00010000:00010000:3.0:1788535958.457759:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.457768:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.457788:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.457796:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.457816:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.457822:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632fe00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:3.0:1788535958.457828:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.457837:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.457862:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.457870:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cdffccf/0xe79af2f39bbdd185 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.457918:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548386048:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 14836us (15138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535958.457925:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:2.0:1788535958.479610:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535958.479650:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548386432 00000100:00100000:2.0:1788535958.479660:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548386432 00000100:00100000:2.0:1788535958.479714:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:2.0:1788535958.479724:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+19:12401:x1875415548386432:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788535958.479802:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.479819:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a8 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.479841:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.479875:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a8 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.479889:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a8 expref: 19 pid: 6534 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535958.479915:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488968a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569416192:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535958.479997:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535958.484369:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488968a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569416192:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535958.484606:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.484669:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548386560 00000100:00100000:1.0:1788535958.484676:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548386560 00010000:00010000:1.0:1788535958.484721:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a8 expref: 20 pid: 6534 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.484752:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535958.484764:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:1.0:1788535958.484775:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048896aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+20:2402:x1875415548386560:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535958.484790:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535958.484797:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a8 expref: 20 pid: 6534 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.484810:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a8 expref: 20 pid: 6534 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.484845:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdcfd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555a8 expref: 20 pid: 6534 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.484861:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535958.484879:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.484889:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.484896:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.484927:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535958.484972:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048896aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+19:2402:x1875415548386560:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 198us (366us total) trans 0 rc 0/0 00010000:00010000:3.0:1788535958.484980:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535958.484980:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00010000:00010000:3.0:1788535958.485003:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.485330:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.485345:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165560a expref: 19 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.485354:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.485385:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165560a expref: 19 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.485556:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165560a expref: 19 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.485573:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004881adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569416320:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535958.486624:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058ddab300 going to sleep for 11 seconds 00000100:00100000:0.0:1788535958.491837:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.491879:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548386688 00000100:00100000:0.0:1788535958.491887:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548386688 00010000:00010000:0.0:1788535958.491935:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165560a expref: 20 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535958.491972:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:0.0:1788535958.491981:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+20:2401:x1875415548386688:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535958.492006:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535958.492014:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165560a expref: 20 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.492037:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165560a expref: 20 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.492067:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd154 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165560a expref: 20 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.492081:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:0.0:1788535958.492086:0:10351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.492096:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.492113:0:10351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535958.492124:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004881adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569416320:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535958.492132:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535958.492160:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.492169:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.492174:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535958.492271:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788535958.492297:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+20:2401:x1875415548386688:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 316us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535958.492304:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000001:00080000:2.0:1788535958.492646:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1788535958.493845:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788535958.495708:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048896a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6533:1875415569416448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788535958.496080:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535958.496186:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788535958.496344:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569416448 00000100:00100000:3.0:1788535958.496352:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569416448 00000100:00100000:3.0:1788535958.496435:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788535958.496445:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1875415569416448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788535958.496529:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1875415569416448:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535958.496537:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788535958.496611:0:6533:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788535958.496617:0:6533:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff900488968e00, transno 4294967316 00000100:00100000:2.0:1788535958.496633:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048896a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6533:1875415569416448:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788535958.496756:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:2.0:1788535958.496884:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048896a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6533:1875415569416576:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788535958.496915:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535958.496939:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788535958.497029:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569416576 00000100:00100000:3.0:1788535958.497039:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569416576 00000100:00100000:3.0:1788535958.497060:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788535958.497067:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1875415569416576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788535958.497431:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6533:x1875415569416576:12345-0@lo:1000:mdt00_000.0 Request processed in 364us (514us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788535958.497439:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788535958.497491:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048896a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6533:1875415569416576:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788535958.497528:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497537:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497546:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497551:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535958.497555:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497562:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497577:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:3.0:1788535958.497580:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535958.497594:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497600:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd193 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497621:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497626:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497639:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497643:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535958.497646:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497652:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497662:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:3.0:1788535958.497665:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535958.497668:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497674:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd0c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497695:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497708:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555ee expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497717:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497742:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555ee expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.497829:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555ee expref: 22 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.497844:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004881ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569416704:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535958.497912:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058ddabc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535958.500645:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004881ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569416704:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535958.500680:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.500710:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.500861:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548386816 00000100:00100000:1.0:1788535958.500868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548386816 00010000:00010000:1.0:1788535958.500901:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555ee expref: 23 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535958.500938:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:1.0:1788535958.500947:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+23:2402:x1875415548386816:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535958.500960:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535958.500966:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555ee expref: 23 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.500990:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555ee expref: 23 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.501011:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd0e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16555ee expref: 23 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.501027:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:1.0:1788535958.501031:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.501040:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.501057:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.501078:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535958.501131:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+22:2402:x1875415548386816:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 185us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535958.501138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00010000:00010000:3.0:1788535958.501424:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501432:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501443:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501528:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501537:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501542:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535958.501546:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501554:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501565:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:3.0:1788535958.501573:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535958.501577:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501594:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd19a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501607:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501613:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501619:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501624:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535958.501627:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501633:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501640:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90059d464c00) 00010000:00010000:3.0:1788535958.501642:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788535958.501645:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.501650:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd18c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.501793:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12401:x1875415548386432:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 22070us (22195us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788535958.501811:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000020:00080000:3.0:1788535958.501815:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788535958.501918:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535958.501923:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535958.502451:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788535958.502461:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788535958.506394:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535958.506756:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548387072 00000100:00100000:2.0:1788535958.506767:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548387072 00000100:00100000:2.0:1788535958.506993:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788535958.507003:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12401:x1875415548387072:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788535958.507263:0:6537:0:(mdd_object.c:4338:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788535958.507291:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:2.0:1788535958.507316:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.507335:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.507345:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.507936:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.507944:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.507951:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.507975:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788535958.508022:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535958.508028:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.508035:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788535958.508040:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.508047:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.508060:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00000100:00100000:2.0:1788535958.508063:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+23:12401:x1875415548387072:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1059us (1685us total) trans 4294967471 rc 0/0 00010000:00010000:0.0:1788535958.508063:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788535958.508068:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535958.508071:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00010000:00010000:0.0:1788535958.508074:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbdd1a1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788535958.508076:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788535958.508084:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535958.508087:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535958.508088:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788535958.552008:0:14718:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535958.552017:0:14718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535958.552041:0:14718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788535958.552049:0:14718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788535958.697025:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.697117:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548387328 00000100:00100000:1.0:1788535958.697127:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548387328 00000100:00100000:1.0:1788535958.697208:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:1.0:1788535958.697217:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+23:12411:x1875415548387328:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535958.697248:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535958.697267:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdd1a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655626 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.697370:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd1af lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.697386:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd1af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.697397:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd1af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535958.697409:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788535958.697516:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbdd1a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655626 expref: 26 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.697532:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd1af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655626 expref: 25 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.697541:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535958.697544:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788535958.697548:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e200, rc 0) 00000100:00100000:1.0:1788535958.697612:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+25:12411:x1875415548387328:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 396us (595us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788535958.697619:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:0.0:1788535958.702886:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.702932:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548387456 00000100:00100000:0.0:1788535958.702941:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548387456 00000100:00100000:0.0:1788535958.702991:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:0.0:1788535958.703002:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+25:12411:x1875415548387456:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1788535958.703071:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703089:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703101:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703116:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703124:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703130:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703217:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703225:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703232:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535958.703273:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703294:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703301:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703308:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703313:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535958.703318:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703325:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703337:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:0.0:1788535958.703339:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535958.703343:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703348:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703360:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703366:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703371:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703382:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535958.703386:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703392:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703400:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900583670e00) 00010000:00010000:0.0:1788535958.703403:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535958.703405:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703411:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbdd1c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703426:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703433:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.703438:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.705499:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535958.705505:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.705516:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.705540:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900583670a00) 00010000:00010000:0.0:1788535958.705543:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535958.705547:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.705553:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd1cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535958.705660:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+25:12411:x1875415548387456:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 2657us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535958.705670:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00010000:00010000:0.0:1788535958.705706:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535958.755554:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.755709:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548387712 00000100:00100000:3.0:1788535958.755726:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548387712 00000100:00100000:3.0:1788535958.755787:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:3.0:1788535958.755797:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+25:12414:x1875415548387712:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535958.755817:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535958.755837:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd1d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165562d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.755908:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.755923:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.755933:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.755946:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.755953:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.755958:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756100:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756109:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756115:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535958.756124:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788535958.756230:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756238:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756246:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756251:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535958.756256:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756263:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756276:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535958.756279:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535958.756282:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756299:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd1d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756313:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756319:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756325:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756330:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535958.756333:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756339:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756348:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900487807100) 00010000:00010000:3.0:1788535958.756351:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535958.756354:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756359:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd1e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756399:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd1d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165562d expref: 28 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756413:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165562d expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.756427:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:3.0:1788535958.756429:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535958.756432:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632ea00, rc 0) 00000100:00100000:3.0:1788535958.756486:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12414:x1875415548387712:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 689us (941us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788535958.756494:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:0.0:1788535958.763521:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.763603:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548387840 00000100:00100000:3.0:1788535958.763613:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548387840 00000100:00100000:3.0:1788535958.763668:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:3.0:1788535958.763678:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12414:x1875415548387840:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1788535958.763846:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.763863:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.763875:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.763907:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.763914:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.763921:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.763926:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535958.763940:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.763948:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.763960:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:3.0:1788535958.763963:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788535958.763968:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.763974:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd1f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.764098:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12414:x1875415548387840:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 420us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535958.764106:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:0.0:1788535958.776186:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.776313:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548388096 00000100:00100000:1.0:1788535958.776323:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548388096 00000100:00100000:1.0:1788535958.776399:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1788535958.776410:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12414:x1875415548388096:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788535958.776646:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+28:12414:x1875415548388096:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 236us (501us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788535958.776655:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1788535958.854979:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.855269:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548388352 00000100:00100000:0.0:1788535958.855278:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548388352 00000100:00100000:0.0:1788535958.855339:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:0.0:1788535958.855350:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+28:11947:x1875415548388352:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788535958.855372:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535958.855392:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655634 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.855493:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.855508:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165562d expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.855535:0:10112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.855571:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165562d expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535958.855597:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165562d expref: 29 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535958.855612:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569416832:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535958.855696:0:10112:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005907419c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535958.862649:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.862726:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548388480 00000100:00100000:3.0:1788535958.862735:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548388480 00010000:00010000:3.0:1788535958.862778:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165562d expref: 30 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535958.862822:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:3.0:1788535958.862832:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+30:2402:x1875415548388480:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535958.862856:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535958.862863:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165562d expref: 30 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.862876:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165562d expref: 30 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.862912:0:10351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:3.0:1788535958.862967:0:10351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.862978:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.862986:0:10351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.863005:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535958.863064:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+30:2402:x1875415548388480:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 232us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535958.863071:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00010000:00010000:1.0:1788535958.863407:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd1e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165562d expref: 29 pid: 6533 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535958.863423:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569416832:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535958.863443:0:10112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.863452:0:10112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.863458:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535958.863477:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788535958.863606:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd1fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655634 expref: 30 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.863622:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655634 expref: 29 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.863629:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:1.0:1788535958.863632:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788535958.863635:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839000, rc 0) 00000100:00100000:1.0:1788535958.863770:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+29:11947:x1875415548388352:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8421us (8800us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788535958.863778:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:0.0:1788535958.868569:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.871992:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548388608 00000100:00100000:1.0:1788535958.872008:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548388608 00000100:00100000:1.0:1788535958.872218:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:1.0:1788535958.872231:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+29:11947:x1875415548388608:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535958.872254:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535958.872274:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd211 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165563b expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.872308:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd218 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.872323:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.872335:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.872450:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd211 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165563b expref: 31 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.872473:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165563b expref: 30 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.872483:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:1.0:1788535958.872486:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788535958.872489:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f800, rc 0) 00000100:00100000:1.0:1788535958.872564:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+30:11947:x1875415548388608:12345-192.168.203.13@tcp:101:bash.0 Request processed in 336us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535958.872571:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:2.0:1788535958.878911:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535958.879119:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548388864 00000100:00100000:3.0:1788535958.879129:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548388864 00000100:00100000:3.0:1788535958.879213:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:3.0:1788535958.879224:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+30:11947:x1875415548388864:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1788535958.879423:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.879440:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.879452:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535958.879490:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1788535958.879509:0:6535:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000ca452ab0 reply state 00000000303abcfa transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.879533:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535958.879541:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:3.0:1788535958.879544:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535958.879548:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788535958.879599:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1788535958.879685:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+34:11947:x1875415548388864:12345-192.168.203.13@tcp:36:bash.0 Request processed in 462us (782us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788535958.879692:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000020:00080000:3.0:1788535958.879697:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788535958.882646:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.882889:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548388992 00000100:00100000:1.0:1788535958.882898:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548388992 00000100:00100000:1.0:1788535958.882953:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:1.0:1788535958.882964:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+34:11947:x1875415548388992:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535958.882985:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535958.883003:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd226 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655642 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.883201:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd226 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655642 expref: 35 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.883217:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd226 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655642 expref: 35 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.883237:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:1.0:1788535958.883241:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788535958.883244:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f600, rc 0) 00000100:00100000:1.0:1788535958.883363:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+35:11947:x1875415548388992:12345-192.168.203.13@tcp:101:bash.0 Request processed in 400us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535958.883371:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:0.0:1788535958.889250:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535958.889347:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548389120 00000100:00100000:2.0:1788535958.889358:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548389120 00000100:00100000:2.0:1788535958.889419:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:2.0:1788535958.889430:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+7:11947:x1875415548389120:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788535958.889448:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535958.889469:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655649 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788535958.889515:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ae495, atime: 0x6a9ae494, ctime: 0x6a9ae495, blocks: 0x8 00010000:00010000:2.0:1788535958.889538:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1788535958.889542:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535958.889551:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655649 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.889567:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655649 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.889589:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067200, rc 0) 00000100:00100000:2.0:1788535958.889652:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:11947:x1875415548389120:12345-192.168.203.13@tcp:101:bash.0 Request processed in 223us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535958.889661:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:2.0:1788535958.898918:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535958.899006:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548389248 00000100:00100000:0.0:1788535958.899023:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548389248 00002000:00010000:0.0:1788535958.899065:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788535958.899070:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff900488968e00 with x1875415548389248 ext(0->18446744073709551615) 00002000:00010000:0.0:1788535958.899081:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff900488968e00. 00000100:00100000:0.0:1788535958.899115:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1788535958.899125:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2399:x1875415548389248:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:0.0:1788535958.899398:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788535958.899402:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788535957 -> 1788535959 00002000:00010000:0.0:1788535958.899405:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788535956 -> 1788535956 00002000:00010000:0.0:1788535958.899407:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788535957 -> 1788535959 00002000:00010000:0.0:1788535958.899420:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788535958.899481:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2399:x1875415548389248:12345-192.168.203.13@tcp:10:bash.0 Request processed in 358us (573us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788535958.899490:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00002000:00010000:0.0:1788535958.899494:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788535958.899498:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff900488968e00 with x1875415548389248 ext(0->18446744073709551615) 00002000:00010000:0.0:1788535958.899503:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff900488968e00. 00000100:00100000:1.0:1788535958.956354:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569416960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788535958.956472:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535958.956603:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569416960 00000100:00100000:0.0:1788535958.956613:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569416960 00000100:00100000:0.0:1788535958.956663:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788535958.956672:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569416960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788535958.956703:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535958.958462:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535958.958481:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004881aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569417088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535958.958533:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535958.958593:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569417088 00000100:00100000:3.0:1788535958.958600:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569417088 00000100:00100000:3.0:1788535958.958633:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788535958.958642:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875415569417088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535958.958659:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535958.958696:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875415569417088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535958.958703:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788535958.958743:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004881aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569417088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535958.961844:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569416960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5163us (5362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535958.961858:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788535958.962386:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535958.962630:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548389376 00000100:00100000:2.0:1788535958.962639:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548389376 00000100:00100000:1.0:1788535958.962790:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488967800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569416960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535958.962853:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:2.0:1788535958.962865:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+35:12428:x1875415548389376:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1788535958.962941:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.962959:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.962970:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963012:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963020:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963027:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963107:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963117:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963124:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788535958.963187:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963198:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963204:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963211:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963217:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535958.963221:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963235:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963247:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:2.0:1788535958.963250:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535958.963255:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963261:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd234 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963274:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963280:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963285:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963289:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535958.963292:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963298:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963305:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900590854900) 00010000:00010000:2.0:1788535958.963308:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535958.963311:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963327:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd23b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963342:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963348:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963355:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963360:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535958.963363:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963369:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963378:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:2.0:1788535958.963381:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535958.963384:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535958.963390:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535958.963464:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+35:12428:x1875415548389376:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 600us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535958.963472:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:3.0:1788535958.995650:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535958.996536:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548389632 00000100:00100000:1.0:1788535958.996559:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548389632 00000100:00100000:1.0:1788535958.996630:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:1.0:1788535958.996640:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+35:12431:x1875415548389632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535958.996659:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535958.996678:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd249 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655650 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.996749:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.996764:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.996776:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.996791:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.996799:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.996805:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.996902:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdd25e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.996912:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdd25e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.996918:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdd25e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535958.996934:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788535958.997000:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.997008:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998174:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998181:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535958.998186:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998195:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998209:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535958.998212:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535958.998217:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998223:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd250 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998238:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998244:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998264:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998269:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620ee00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535958.998271:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998276:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998285:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9005b7b03900) 00010000:00010000:1.0:1788535958.998287:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535958.998290:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998295:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd257 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998410:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e400/0xe79af2f39bbdd249 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655650 expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998424:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdd25e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655650 expref: 37 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535958.998432:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:1.0:1788535958.998434:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788535958.999069:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f200, rc 0) 00000100:00100000:1.0:1788535958.999143:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+37:12431:x1875415548389632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2503us (3509us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788535958.999275:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:0.0:1788535959.004142:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.004313:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548389760 00000100:00100000:1.0:1788535959.004322:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548389760 00000100:00100000:1.0:1788535959.004433:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:1.0:1788535959.004443:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+37:12431:x1875415548389760:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1788535959.004504:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.004522:0:10112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655634 expref: 37 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.004532:0:10112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.004567:0:10112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655634 expref: 37 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.004593:0:10112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655634 expref: 37 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535959.004608:0:10112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90058ad0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569417216:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535959.004748:0:10112:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3b900 going to sleep for 11 seconds 00000100:00080000:2.0:1788535959.005554:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535959.013345:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.013428:0:10112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90058ad0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10112:1875415569417216:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535959.013453:0:10112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535959.013527:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548390016 00000100:00100000:0.0:1788535959.013534:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548390016 00000100:00100000:0.0:1788535959.013634:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1788535959.013653:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+38:6637:x1875415548390016:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788535959.013924:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+39:6637:x1875415548390016:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 282us (588us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788535959.013933:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1788535959.016206:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.016288:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548390144 00000100:00100000:2.0:1788535959.016296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548390144 00010000:00010000:2.0:1788535959.016331:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655634 expref: 39 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535959.016368:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:2.0:1788535959.016378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+39:2401:x1875415548390144:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788535959.016392:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535959.016398:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655634 expref: 39 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.016412:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655634 expref: 39 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.016433:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd203 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655634 expref: 39 pid: 10112 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.016518:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:2.0:1788535959.016523:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.016533:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.016541:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.016570:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535959.016620:0:10112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.016636:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.016670:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535959.016683:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+38:2401:x1875415548390144:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 306us (482us total) trans 0 rc 0/0 00010000:00010000:1.0:1788535959.016688:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.016697:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535959.016700:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00010000:00010000:1.0:1788535959.016984:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535959.016992:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.017001:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.017012:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:1.0:1788535959.017015:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788535959.017019:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.017041:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f400/0xe79af2f39bbdd26c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535959.017085:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+37:12431:x1875415548389760:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 12643us (12952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535959.017093:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:1.0:1788535959.022489:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.023724:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548390400 00000100:00100000:2.0:1788535959.023735:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548390400 00000100:00100000:2.0:1788535959.023798:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1788535959.023809:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+37:12431:x1875415548390400:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788535959.024027:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+38:12431:x1875415548390400:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 218us (1546us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788535959.024035:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1788535959.118826:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.118970:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548390656 00000100:00100000:2.0:1788535959.118981:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548390656 00000100:00100000:2.0:1788535959.119045:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:2.0:1788535959.119056:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+38:12442:x1875415548390656:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788535959.119084:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535959.119105:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd273 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655657 expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119203:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119218:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119229:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119242:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119262:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119268:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119364:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd288 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119373:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119380:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd288 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535959.119389:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788535959.119470:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119478:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119485:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119490:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535959.119494:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119502:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119523:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:2.0:1788535959.119526:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535959.119531:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119537:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd27a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119550:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119556:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119562:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119567:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535959.119569:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119583:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119591:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900590854900) 00010000:00010000:2.0:1788535959.119594:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535959.119597:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119602:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066600/0xe79af2f39bbdd281 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119653:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd273 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655657 expref: 41 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119666:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655657 expref: 40 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.119673:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:2.0:1788535959.119676:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535959.119679:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066a00, rc 0) 00000100:00100000:2.0:1788535959.119854:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+40:12442:x1875415548390656:12345-192.168.203.13@tcp:101:cat.0 Request processed in 799us (1035us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788535959.119862:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:3.0:1788535959.125962:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.126120:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548390912 00000100:00100000:0.0:1788535959.126129:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548390912 00000100:00100000:0.0:1788535959.126218:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1788535959.126227:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+40:12442:x1875415548390912:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:0.0:1788535959.126488:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+41:12442:x1875415548390912:12345-192.168.203.13@tcp:35:cat.0 Request processed in 261us (535us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788535959.126496:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1788535959.167181:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535959.167532:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548391168 00000100:00100000:3.0:1788535959.167542:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548391168 00000100:00100000:3.0:1788535959.167626:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:3.0:1788535959.167636:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+41:12443:x1875415548391168:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:3.0:1788535959.167714:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788535959.167742:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbdd226 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655642 expref: 41 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167766:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066a00/0xe79af2f39bbdd288 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655657 expref: 40 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167780:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbdd25e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655650 expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167792:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd218 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165563b expref: 38 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167802:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:3.0:1788535959.167807:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535959.167828:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167842:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167863:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167897:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167905:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167911:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167981:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167989:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.167994:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788535959.168468:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:3.0:1788535959.168513:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168521:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168529:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168536:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168542:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168556:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168567:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788535959.168596:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168603:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168609:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168615:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535959.168618:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168625:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168635:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:0.0:1788535959.168717:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535959.168724:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168825:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788535959.168832:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168839:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168863:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168869:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168881:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168886:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535959.168889:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168895:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168903:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535959.168906:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535959.168909:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168914:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd296 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535959.168924:0:6533:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000005be43e8c reply state 0000000002c264e0 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168933:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.168939:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900487807100) 00010000:00010000:3.0:1788535959.168941:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788535959.168943:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788535959.169020:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+39:12443:x1875415548391168:12345-192.168.203.13@tcp:36:rm.0 Request processed in 1385us (1871us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788535959.169028:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00010000:00010000:0.0:1788535959.170475:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788535959.170488:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.170501:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.170516:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:0.0:1788535959.170519:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788535959.170523:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.170530:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd2ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.170549:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535959.170551:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535959.170554:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535959.222672:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.222856:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548391424 00000100:00100000:1.0:1788535959.222866:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548391424 00000100:00100000:1.0:1788535959.222926:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:1.0:1788535959.222936:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+39:12449:x1875415548391424:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535959.222961:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535959.222982:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd2b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165565e expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223085:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223099:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223111:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223120:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223127:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223133:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788535959.223455:0:10112:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788535959.223603:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223629:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223637:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223671:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223679:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223685:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223692:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535959.223697:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223705:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223716:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535959.223719:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535959.223724:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223731:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbdd2b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788535959.223744:0:10112:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000004e578e8a reply state 0000000041fc476a transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223762:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223768:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900487807100) 00010000:00010000:1.0:1788535959.223771:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788535959.223773:0:10112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788535959.223802:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f000/0xe79af2f39bbdd2b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165565e expref: 42 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223819:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165565e expref: 41 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.223825:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9005b7b03900) 00010000:00010000:1.0:1788535959.223827:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535959.223829:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f800, rc 0) 00000100:00100000:1.0:1788535959.224027:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+42:12449:x1875415548391424:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1091us (1366us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788535959.224034:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:1.0:1788535959.242002:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.244566:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548391552 00000100:00100000:2.0:1788535959.244591:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548391552 00000100:00100000:2.0:1788535959.244759:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1788535959.244769:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2401:x1875415548391552:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788535959.244787:0:10017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535959.244807:0:10017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655665 expref: -99 pid: 10017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788535959.244831:0:10017:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788535959.245141:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1788535959.245167:0:10017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535959.245177:0:10017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655665 expref: 8 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.245217:0:10017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655665 expref: 8 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.245230:0:10017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066000, rc 0) 00000100:00100000:2.0:1788535959.245301:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548391552:12345-192.168.203.13@tcp:101:bash.0 Request processed in 533us (3306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535959.245309:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00080000:1.0:1788535959.249558:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535959.253969:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.254210:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548391680 00000100:00100000:2.0:1788535959.254220:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548391680 00000100:00100000:2.0:1788535959.254286:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:2.0:1788535959.254297:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005c191ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+8:12449:x1875415548391680:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1788535959.254314:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535959.254331:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165566c expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.254360:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655665 expref: 9 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.254369:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535959.254373:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535959.254379:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.254411:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655665 expref: 9 pid: 10017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.254439:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655665 expref: 9 pid: 10017 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535959.254454:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048896aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8446:1875415569417344:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535959.254558:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788535959.258181:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.258481:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048896aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8446:1875415569417344:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535959.258515:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.258534:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066600, rc 0) 00000100:00100000:2.0:1788535959.258613:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005c191ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+9:12449:x1875415548391680:12345-192.168.203.13@tcp:101:bash.0 Request processed in 4317us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535959.258622:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1788535959.260164:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548391808 00000100:00100000:0.0:1788535959.260175:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548391808 00010000:00010000:0.0:1788535959.260231:0:10351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655665 expref: 9 pid: 10017 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535959.260319:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:0.0:1788535959.260330:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2401:x1875415548391808:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535959.260343:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535959.260365:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655665 expref: 9 pid: 10017 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.260379:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655665 expref: 9 pid: 10017 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.260401:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd2d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655665 expref: 9 pid: 10017 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.260432:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535959.260436:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535959.260445:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.260456:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.260490:0:10351:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535959.260517:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10351:1875415569417472:192.168.203.13@tcp:105: 00000100:00100000:0.0:1788535959.260599:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff900590741540 going to sleep for 11 seconds 00000100:00100000:0.0:1788535959.265110:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10351:1875415569417472:192.168.203.13@tcp:105: 00010000:00010000:0.0:1788535959.265294:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535959.265382:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548391808:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5053us (7238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535959.265392:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:1.0:1788535959.266711:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.266966:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548392064 00000100:00100000:0.0:1788535959.266975:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548392064 00000100:00100000:0.0:1788535959.267027:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1788535959.267036:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+42:12449:x1875415548392064:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1788535959.267331:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+43:12449:x1875415548392064:12345-192.168.203.13@tcp:35:bash.0 Request processed in 294us (634us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788535959.267338:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1788535959.438414:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.438514:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548392192 00000100:00100000:0.0:1788535959.438524:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548392192 00000100:00100000:0.0:1788535959.438612:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:0.0:1788535959.438622:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+43:12466:x1875415548392192:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535959.438649:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535959.438669:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd2e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655673 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.438746:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd2ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.438777:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.438801:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535959.439081:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788535959.439086:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535959.439109:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.439135:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd2e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655673 expref: 45 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.439188:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd2ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655673 expref: 44 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.439197:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:0.0:1788535959.439200:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788535959.439203:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838000, rc 0) 00000100:00100000:0.0:1788535959.439266:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+44:12466:x1875415548392192:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 646us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535959.439274:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:2.0:1788535959.443419:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535959.443535:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548392448 00000100:00100000:3.0:1788535959.443544:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548392448 00000100:00100000:3.0:1788535959.443808:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:3.0:1788535959.443821:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+44:12466:x1875415548392448:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535959.444056:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535959.444081:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd2f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165567a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.444223:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.444238:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.444250:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535959.444262:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788535959.444365:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd2f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165567a expref: 47 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.444384:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165567a expref: 46 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.444392:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9005b7b03900) 00010000:00010000:3.0:1788535959.444395:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535959.444398:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632e600, rc 0) 00000100:00100000:3.0:1788535959.444455:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+46:12466:x1875415548392448:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 636us (1045us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788535959.444475:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:1.0:1788535959.455469:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.455518:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.455620:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548392704 00000100:00100000:0.0:1788535959.455631:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548392704 00000100:00100000:0.0:1788535959.455703:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:0.0:1788535959.455715:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+46:12466:x1875415548392704:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535959.455737:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535959.455771:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd306 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655681 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.455894:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd30d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.455907:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.455919:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd30d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535959.455932:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788535959.456031:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd306 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655681 expref: 49 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.456050:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd30d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655681 expref: 48 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.456058:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9005b7b03900) 00010000:00010000:0.0:1788535959.456061:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788535959.456064:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838c00, rc 0) 00000100:00100000:0.0:1788535959.456129:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+48:12466:x1875415548392704:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 416us (609us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1788535959.456136:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:3.0:1788535959.456423:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548392832 00000100:00100000:3.0:1788535959.456428:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548392832 00000100:00100000:3.0:1788535959.456475:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1788535959.456483:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+48:2401:x1875415548392832:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535959.456492:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535959.456507:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd2f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165567a expref: 48 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.456519:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9005b7b03900) 00010000:00010000:3.0:1788535959.456522:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535959.456544:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+47:2401:x1875415548392832:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 63us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535959.456551:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1788535959.468243:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.468449:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569417600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788535959.468499:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535959.468648:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569417600 00000100:00100000:0.0:1788535959.468656:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569417600 00000100:00100000:0.0:1788535959.468713:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788535959.468722:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569417600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788535959.468753:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535959.468811:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569417600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535959.468819:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788535959.469114:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569417600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788535959.469290:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548392960 00000100:00100000:3.0:1788535959.469294:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548392960 00000100:00100000:3.0:1788535959.469329:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1788535959.469336:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2402:x1875415548392960:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:3.0:1788535959.469365:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.469385:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.469394:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788535959.469398:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535959.469410:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.469439:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.469452:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 8 pid: 8446 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535959.469465:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004881ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1875415569417728:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535959.469534:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058ddabc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788535959.478174:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.478265:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548393088 00000100:00100000:0.0:1788535959.478274:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548393088 00002000:00100000:0.0:1788535959.478323:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90048896aa00 x1875415548393088/t0(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:615/0 lens 504/0 e 0 to 0 dl 1788535970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535959.478334:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90048896aa00 with x1875415548393088 ext(0->8) 00010000:00010000:0.0:1788535959.478343:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 9 pid: 8446 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.478361:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 9 pid: 8446 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535959.478370:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90048896aa00 00000100:00100000:0.0:1788535959.478405:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1788535959.478415:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048896aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2401:x1875415548393088:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:0.0:1788535959.482062:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048896aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+11:2401:x1875415548393088:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 3637us (3907us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788535959.482075:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:0.0:1788535959.482088:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90048896aa00 x1875415548393088/t4294967309(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:615/0 lens 504/448 e 0 to 0 dl 1788535970 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535959.482099:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90048896aa00 with x1875415548393088 ext(0->8) 00010000:00010000:0.0:1788535959.482110:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 11 pid: 8446 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.482167:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 11 pid: 8446 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788535959.482176:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90048896aa00 00000100:00100000:3.0:1788535959.482433:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004881ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8448:1875415569417728:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535959.482456:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535959.492763:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535959.493432:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548393216 00000100:00100000:3.0:1788535959.493442:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548393216 00010000:00010000:3.0:1788535959.493485:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 11 pid: 8446 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535959.493519:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:3.0:1788535959.493534:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+11:2401:x1875415548393216:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535959.493549:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788535959.493567:0:6519:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788535959.493570:0:6519:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788535959 00002000:00010000:3.0:1788535959.493572:0:6519:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788535959 00002000:00010000:3.0:1788535959.493596:0:6519:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788535959 00002000:00010000:3.0:1788535959.493598:0:6519:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788535959.493606:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 11 pid: 8446 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.493620:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 11 pid: 8446 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.493709:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d2bd872/0xe79af2f39bbdd2dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165566c expref: 11 pid: 8446 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.493727:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535959.493731:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535959.493737:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.493746:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.493932:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535959.494037:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+10:2401:x1875415548393216:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 508us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535959.494046:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00010000:00010000:1.0:1788535959.494178:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.494188:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.494208:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.494217:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.494225:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.494233:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e600 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788535959.494236:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.494245:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.494258:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.494279:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a74ece2/0xe79af2f39bbdd31b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535959.494329:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2402:x1875415548392960:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 24992us (26097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535959.494336:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1788535959.503225:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.503346:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548393472 00000100:00100000:2.0:1788535959.503356:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548393472 00000100:00100000:2.0:1788535959.503415:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:2.0:1788535959.503426:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf16450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+47:12466:x1875415548393472:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:2.0:1788535959.503491:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd30d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655681 expref: 47 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535959.503708:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788535959.503763:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1788535959.504366:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1788535959.504407:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.504423:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165565e expref: 51 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.504433:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.504467:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165565e expref: 51 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.504482:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165565e expref: 51 pid: 10112 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535959.504496:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048896b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875415569417856:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535959.504620:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788535959.510702:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.510941:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548393600 00000100:00100000:1.0:1788535959.510950:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548393600 00010000:00010000:1.0:1788535959.510988:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165565e expref: 52 pid: 10112 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535959.511028:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:1.0:1788535959.511038:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048896bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+52:2401:x1875415548393600:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535959.511051:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535959.511058:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165565e expref: 52 pid: 10112 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.511071:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165565e expref: 52 pid: 10112 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.511092:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9005b7b03900) 00010000:00010000:1.0:1788535959.511097:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.511106:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.511126:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.511173:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535959.511221:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048896bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+52:2401:x1875415548393600:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 185us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535959.511230:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00010000:00010000:3.0:1788535959.511905:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd2c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165565e expref: 51 pid: 10112 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535959.511925:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048896b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875415569417856:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535959.511955:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.511965:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.511971:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788535959.512077:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:3.0:1788535959.512224:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1788535959.512309:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004881ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875415569417984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788535959.512373:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535959.512411:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058ddab300 going to sleep for 11 seconds 00000100:00100000:2.0:1788535959.512884:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569417984 00000100:00100000:2.0:1788535959.512893:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569417984 00000100:00100000:2.0:1788535959.512950:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788535959.512959:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6537:x1875415569417984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788535959.513048:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6537:x1875415569417984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535959.513055:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:1.0:1788535959.513162:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535959.513234:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004881ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875415569417984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788535959.513330:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:3.0:1788535959.513374:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004881ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875415569418112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788535959.513400:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535959.513422:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058ddab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535959.513484:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569418112 00000100:00100000:2.0:1788535959.513488:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569418112 00000100:00100000:2.0:1788535959.513520:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788535959.513527:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6537:x1875415569418112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788535959.513625:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6537:x1875415569418112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (224us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788535959.513632:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788535959.513971:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004881ac700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875415569418112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788535959.514005:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788535959.514031:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.514040:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.514047:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.514063:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535959.514068:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.514076:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.514089:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9005b7b03900) 00010000:00010000:3.0:1788535959.514092:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788535959.514096:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.514103:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd322 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788535959.514476:0:6537:0:(mdd_object.c:4338:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788535959.514533:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788535959.514544:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418318396512ns, next at 419318394215ns, rc = 0 00000001:00080000:2.0:1788535959.514549:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1788535959.514569:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9005b7b03900) 00010000:00010000:2.0:1788535959.514572:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788535959.514589:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd30d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655681 expref: 55 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535959.516355:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf16450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+54:12466:x1875415548393472:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 12924us (13133us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788535959.516367:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000020:00080000:2.0:1788535959.516372:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788535959.520876:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535959.520986:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548393728 00000100:00100000:3.0:1788535959.520995:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548393728 00000100:00100000:3.0:1788535959.521050:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:3.0:1788535959.521059:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+54:12466:x1875415548393728:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535959.521083:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535959.521105:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd329 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655688 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.521189:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655688 expref: 55 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.521204:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd329 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655688 expref: 55 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.521242:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:3.0:1788535959.521245:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535959.521248:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632e200, rc 0) 00000100:00100000:3.0:1788535959.521294:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+55:12466:x1875415548393728:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 236us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535959.521301:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:3.0:1788535959.523587:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.523672:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548393984 00000100:00100000:0.0:1788535959.523681:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548393984 00000100:00100000:0.0:1788535959.523742:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1788535959.523751:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+55:12466:x1875415548393984:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788535959.524104:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+56:12466:x1875415548393984:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 353us (534us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788535959.524113:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1788535959.607140:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535959.607238:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548394112 00000100:00100000:3.0:1788535959.607247:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548394112 00000100:00100000:3.0:1788535959.607307:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:3.0:1788535959.607318:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+56:12476:x1875415548394112:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1788535959.607390:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607408:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607420:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607431:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607438:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607445:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607530:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607539:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607545:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788535959.607601:0:6533:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607615:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607622:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607629:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607636:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535959.607649:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607657:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607668:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535959.607671:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535959.607676:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607699:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd330 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607714:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607720:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607726:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607731:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535959.607734:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607741:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607748:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900487807100) 00010000:00010000:3.0:1788535959.607751:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535959.607753:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607758:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607768:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607773:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607785:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607790:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632ea00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535959.607793:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607799:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607806:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:3.0:1788535959.607808:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535959.607811:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.607817:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd33e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535959.607891:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+56:12476:x1875415548394112:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 574us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535959.607899:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:2.0:1788535959.643656:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.643796:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548394368 00000100:00100000:1.0:1788535959.643806:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548394368 00000100:00100000:1.0:1788535959.643871:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:1.0:1788535959.643882:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+56:12479:x1875415548394368:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788535959.643902:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535959.643923:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd345 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165568f expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644015:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644030:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644041:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644051:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644068:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644075:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644220:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd35a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644229:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd35a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644237:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd35a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535959.644246:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788535959.644317:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644325:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644332:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644339:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620ec00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535959.644343:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644351:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644373:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535959.644375:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535959.644379:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644386:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ec00/0xe79af2f39bbdd34c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644399:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644405:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644411:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644415:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535959.644418:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644424:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644431:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900487807100) 00010000:00010000:1.0:1788535959.644433:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535959.644436:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644441:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd353 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644488:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd345 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165568f expref: 59 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644503:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd35a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165568f expref: 58 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.644511:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:1.0:1788535959.644513:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535959.644515:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620fe00, rc 0) 00000100:00100000:1.0:1788535959.644584:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+58:12479:x1875415548394368:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 695us (940us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788535959.644592:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:1.0:1788535959.651478:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.651569:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548394496 00000100:00100000:2.0:1788535959.651588:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548394496 00000100:00100000:2.0:1788535959.651652:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:2.0:1788535959.651662:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+58:12479:x1875415548394496:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788535959.651736:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.651751:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.651776:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.651813:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.651820:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.651827:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.651832:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535959.651836:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.651843:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.651854:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535959.651857:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788535959.651862:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.651868:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd368 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535959.651986:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+58:12479:x1875415548394496:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 324us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535959.651994:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:2.0:1788535959.656345:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.656530:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548394752 00000100:00100000:0.0:1788535959.656540:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548394752 00000100:00100000:0.0:1788535959.656604:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1788535959.656615:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048896b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+58:12479:x1875415548394752:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1788535959.656870:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048896b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+59:12479:x1875415548394752:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 255us (532us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788535959.656877:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00010000:00010000:0.0:1788535959.724507:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535959.762965:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.763279:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548395008 00000100:00100000:1.0:1788535959.763289:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548395008 00000100:00100000:1.0:1788535959.763350:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:1.0:1788535959.763359:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+59:12489:x1875415548395008:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788535959.763381:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535959.763384:0:10112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788535959.763409:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd2ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655673 expref: 59 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.763430:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:1.0:1788535959.763435:0:10112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535959.763447:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd36f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655696 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.763562:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd376 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.763587:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.763598:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535959.763608:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788535959.763720:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd36f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655696 expref: 61 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.763737:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd376 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655696 expref: 60 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.763744:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:1.0:1788535959.763802:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788535959.763807:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f800, rc 0) 00000100:00100000:1.0:1788535959.763903:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+60:12489:x1875415548395008:12345-192.168.203.13@tcp:101:bash.0 Request processed in 544us (962us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788535959.763911:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:3.0:1788535959.774299:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535959.774352:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.774443:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548395136 00000100:00100000:0.0:1788535959.774452:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548395136 00000100:00100000:0.0:1788535959.774511:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:0.0:1788535959.774520:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+60:12489:x1875415548395136:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788535959.774560:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535959.774590:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839400/0xe79af2f39bbdd384 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165569d expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.774626:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.774641:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.774651:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.774794:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839400/0xe79af2f39bbdd384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165569d expref: 62 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.774814:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165569d expref: 61 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.774823:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:0.0:1788535959.774825:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788535959.774830:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838000, rc 0) 00000100:00100000:0.0:1788535959.774896:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+61:12489:x1875415548395136:12345-192.168.203.13@tcp:101:bash.0 Request processed in 376us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535959.774903:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:1.0:1788535959.775078:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548395264 00000100:00100000:1.0:1788535959.775084:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548395264 00000100:00100000:1.0:1788535959.775128:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788535959.775136:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+61:2400:x1875415548395264:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535959.775172:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535959.775195:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd376 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655696 expref: 61 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.775208:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:1.0:1788535959.775211:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535959.775239:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+60:2400:x1875415548395264:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 105us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535959.775246:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1788535959.779051:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.779108:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548395520 00000100:00100000:1.0:1788535959.779118:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548395520 00000100:00100000:1.0:1788535959.779213:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:1.0:1788535959.779223:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+60:12489:x1875415548395520:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:1.0:1788535959.779271:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535959.779296:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fe00/0xe79af2f39bbdd35a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165568f expref: 60 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.779316:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:1.0:1788535959.779321:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535959.779473:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.779488:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.779498:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788535959.779537:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:1.0:1788535959.779560:0:6533:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000da72b7e8 reply state 000000004e395d0c transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.779596:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.779603:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:1.0:1788535959.779606:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788535959.779608:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788535959.779704:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+62:12489:x1875415548395520:12345-192.168.203.13@tcp:36:bash.0 Request processed in 481us (669us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788535959.779711:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 225 00000020:00080000:1.0:1788535959.779717:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788535959.782001:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.785452:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548395648 00000100:00100000:0.0:1788535959.785468:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548395648 00000100:00100000:0.0:1788535959.785852:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:0.0:1788535959.785864:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+62:12489:x1875415548395648:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1788535959.785903:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535959.785924:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839400/0xe79af2f39bbdd399 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556a4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.786013:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.786028:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.786608:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535959.786958:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788535959.786963:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535959.786986:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.787020:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839400/0xe79af2f39bbdd399 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556a4 expref: 64 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.787880:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556a4 expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.787897:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:0.0:1788535959.787900:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535959.787905:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839800, rc 0) 00000100:00100000:0.0:1788535959.788030:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900485d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+63:12489:x1875415548395648:12345-192.168.203.13@tcp:101:bash.0 Request processed in 2167us (6036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535959.788050:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:3.0:1788535959.799631:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.799743:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548395904 00000100:00100000:0.0:1788535959.799752:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548395904 00000100:00100000:0.0:1788535959.799803:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:0.0:1788535959.799814:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+63:12489:x1875415548395904:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1788535959.800046:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+64:12489:x1875415548395904:12345-192.168.203.13@tcp:35:bash.0 Request processed in 227us (417us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788535959.800054:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1788535959.870258:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.870362:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548396032 00000100:00100000:2.0:1788535959.870372:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548396032 00000100:00100000:2.0:1788535959.870433:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:2.0:1788535959.870443:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+64:12495:x1875415548396032:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788535959.870465:0:10016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535959.870483:0:10016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdd3a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556ab expref: -99 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.870550:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdd3ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.870565:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdd3ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.870585:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdd3ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535959.870628:0:10016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788535959.870632:0:10016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788535959.870650:0:10016:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdd3ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.870675:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdd3a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ab expref: 66 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.870718:0:10016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdd3ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ab expref: 65 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.870726:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:2.0:1788535959.870743:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535959.870747:0:10016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067e00, rc 0) 00000100:00100000:2.0:1788535959.870806:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+65:12495:x1875415548396032:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 364us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535959.870813:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:3.0:1788535959.885265:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.885372:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548396160 00000100:00100000:0.0:1788535959.885381:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548396160 00000100:00100000:0.0:1788535959.885438:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:0.0:1788535959.885448:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+65:12495:x1875415548396160:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535959.885466:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535959.885486:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839400/0xe79af2f39bbdd3b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556b2 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885550:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885565:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885587:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885599:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885606:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885630:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885719:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd3ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885729:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885735:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535959.885776:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788535959.885780:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535959.885799:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885811:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885819:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885826:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885832:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885838:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535959.885842:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885856:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885869:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:0.0:1788535959.885872:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535959.885877:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885883:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885897:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885903:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885908:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885912:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535959.885914:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885920:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885926:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900487807100) 00010000:00010000:0.0:1788535959.885929:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535959.885932:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885945:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885971:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839400/0xe79af2f39bbdd3b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b2 expref: 67 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885984:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd3ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b2 expref: 66 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.885991:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:0.0:1788535959.885993:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535959.885995:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839000, rc 0) 00000100:00100000:0.0:1788535959.886057:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12495:x1875415548396160:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 611us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535959.886064:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:3.0:1788535959.896627:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.896868:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548396288 00000100:00100000:1.0:1788535959.896878:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548396288 00000100:00100000:1.0:1788535959.896943:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:1.0:1788535959.896952:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+66:2401:x1875415548396288:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535959.896966:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535959.896988:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839000/0xe79af2f39bbdd3ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b2 expref: 66 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.897007:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:1.0:1788535959.897012:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535959.897064:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+65:2401:x1875415548396288:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 113us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535959.897072:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:1.0:1788535959.900513:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.902224:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548396544 00000100:00100000:0.0:1788535959.902235:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548396544 00000100:00100000:0.0:1788535959.902340:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:0.0:1788535959.902350:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048816b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+65:12495:x1875415548396544:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535959.902369:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535959.902388:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839400/0xe79af2f39bbdd3d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556b9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.902485:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.902499:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556a4 expref: 66 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.902534:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.902568:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556a4 expref: 66 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.902591:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556a4 expref: 66 pid: 6534 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535959.902605:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875415569418240:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535959.902715:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff900590741cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535959.906925:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.907263:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875415569418240:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535959.907297:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535959.907796:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548396672 00000100:00100000:3.0:1788535959.907803:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548396672 00010000:00010000:3.0:1788535959.907838:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556a4 expref: 67 pid: 6534 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535959.907880:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:3.0:1788535959.907892:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+67:2402:x1875415548396672:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535959.907906:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535959.907913:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556a4 expref: 67 pid: 6534 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.907926:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556a4 expref: 67 pid: 6534 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.907948:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839800/0xe79af2f39bbdd3a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556a4 expref: 67 pid: 6534 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.907964:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:3.0:1788535959.907969:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.907978:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.907986:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535959.908018:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535959.908069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+66:2402:x1875415548396672:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 179us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535959.908091:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00010000:00010000:1.0:1788535959.908420:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.908439:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788535959.908456:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788535959.908592:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839400/0xe79af2f39bbdd3d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b9 expref: 67 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.908608:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b9 expref: 66 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.908615:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:1.0:1788535959.908617:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788535959.908620:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839e00, rc 0) 00000100:00100000:1.0:1788535959.908668:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048816b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12495:x1875415548396544:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 6319us (8163us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788535959.908674:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:3.0:1788535959.915042:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535959.917252:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548396928 00000100:00100000:2.0:1788535959.917267:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548396928 00000100:00100000:2.0:1788535959.917348:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1788535959.917359:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058ad6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12495:x1875415548396928:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:2.0:1788535959.917376:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535959.917401:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd329 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655688 expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535959.917421:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535959.917425:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535959.917486:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058ad6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+65:12495:x1875415548396928:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 130us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535959.917494:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788535959.924300:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535959.926480:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548397056 00000100:00100000:1.0:1788535959.926494:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548397056 00000100:00100000:1.0:1788535959.926603:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:1.0:1788535959.926614:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004881af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+65:12495:x1875415548397056:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:1.0:1788535959.926720:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.926737:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535959.926748:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788535959.926875:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788535959.926965:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004881af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+65:12495:x1875415548397056:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 352us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535959.926973:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:3.0:1788535959.930280:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535959.930441:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548397184 00000100:00100000:0.0:1788535959.930451:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548397184 00000100:00100000:0.0:1788535959.930509:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:0.0:1788535959.930519:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+65:12495:x1875415548397184:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788535959.930537:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535959.930555:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556c0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.930621:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.930651:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c0 expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.930806:0:6535:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.930832:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c0 expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.930846:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:0.0:1788535959.930993:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788535959.930999:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c0 expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535959.931008:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838c00, rc 0) 00000100:00100000:0.0:1788535959.931061:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12495:x1875415548397184:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 545us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535959.931068:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:1.0:1788535959.980957:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788535959.980981:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569418368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788535959.981053:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535959.981522:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569418368 00000100:00100000:2.0:1788535959.981531:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569418368 00000100:00100000:2.0:1788535959.981597:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788535959.981606:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569418368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788535959.981642:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788535959.981711:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569418368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535959.981718:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788535959.982075:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569418368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535960.444339:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.444398:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.444433:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.444459:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.444478:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.444494:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.444521:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548397696 00000100:00100000:2.0:1788535960.444531:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548397696 00000100:00100000:2.0:1788535960.444584:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548397824 00000100:00100000:2.0:1788535960.444587:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548397824 00000100:00100000:2.0:1788535960.444619:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:0.0:1788535960.444668:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548397440 00000100:00100000:0.0:1788535960.444672:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548397440 00000100:00100000:0.0:1788535960.444701:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548397952 00000100:00100000:0.0:1788535960.444704:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548397952 00000100:00100000:0.0:1788535960.444724:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548397568 00000100:00100000:0.0:1788535960.444727:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548397568 00000100:00100000:0.0:1788535960.444743:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 306 00000100:00100000:0.0:1788535960.444751:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048896ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+66:2402:x1875415548397440:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535960.444828:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048896ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+66:2402:x1875415548397440:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.444836:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 306 00000100:00100000:0.0:1788535960.444863:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 307 00000100:00100000:0.0:1788535960.444869:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548397952:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535960.444894:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048896bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548397952:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.444900:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 307 00000100:00100000:0.0:1788535960.444912:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 308 00000100:00100000:0.0:1788535960.444919:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548397568:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535960.444942:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048896b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548397568:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.444948:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 308 00000100:00100000:1.0:1788535960.445038:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548397312 00000100:00100000:1.0:1788535960.445042:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548397312 00000100:00100000:1.0:1788535960.445069:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 385 00000100:00100000:1.0:1788535960.445075:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548397312:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535960.445101:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548397312:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.445123:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 385 00000100:00080000:1.0:1788535960.445178:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535960.445183:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788535960.445185:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535960.445229:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048896a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2402:x1875415548397696:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535960.445261:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048896a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2402:x1875415548397696:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 635us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535960.448656:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:3.0:1788535960.448685:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2402:x1875415548397824:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535960.448759:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2402:x1875415548397824:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 90us (4263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535960.448835:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:3.0:1788535960.448972:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535960.449074:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548398080 00000100:00100000:3.0:1788535960.449081:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548398080 00000100:00100000:3.0:1788535960.449134:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 309 00000100:00100000:3.0:1788535960.449142:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548398080:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535960.449193:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548398080:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 52us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535960.449201:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 309 00000100:00080000:3.0:1788535960.449227:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535960.456785:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000040:00080000:2.0:1788535960.556590:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535960.556600:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535960.556626:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788535960.556636:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535960.556876:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888df100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569418496:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788535960.556995:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788535960.560072:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888df100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569418496:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788535960.566605:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.567295:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548398208 00000100:00100000:0.0:1788535960.567306:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548398208 00000100:00100000:0.0:1788535960.567377:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:0.0:1788535960.567387:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12497:x1875415548398208:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788535960.567419:0:6534:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788535960.567655:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004880c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12497:x1875415548398208:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 268us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.567663:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:3.0:1788535960.577521:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.577628:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548398336 00000100:00100000:0.0:1788535960.577646:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548398336 00000100:00100000:0.0:1788535960.577709:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:0.0:1788535960.577735:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12497:x1875415548398336:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788535960.577819:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.577836:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.577850:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.577878:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.577886:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.577893:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.577915:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.577923:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.577929:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535960.577970:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788535960.577976:0:10112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535960.577988:0:10112:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578010:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578017:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578023:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578028:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535960.578032:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578038:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578049:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:0.0:1788535960.578052:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535960.578057:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578063:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd3f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578074:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578080:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578085:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578096:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535960.578099:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578105:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578113:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff900583670a00) 00010000:00010000:0.0:1788535960.578115:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535960.578118:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578124:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd3fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578139:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578189:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578196:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578201:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838a00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535960.578204:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578209:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578227:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:0.0:1788535960.578230:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535960.578233:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.578239:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838a00/0xe79af2f39bbdd402 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.578321:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12497:x1875415548398336:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 587us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.578329:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:3.0:1788535960.584303:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.584613:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548398592 00000100:00100000:0.0:1788535960.584623:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548398592 00000100:00100000:0.0:1788535960.585114:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:0.0:1788535960.585132:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+66:12497:x1875415548398592:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535960.585169:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535960.585189:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd409 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556c7 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585292:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585308:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585319:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535960.585330:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788535960.585416:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585424:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585430:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585436:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535960.585440:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585448:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585459:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:0.0:1788535960.585462:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788535960.585466:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585473:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd410 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585511:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd409 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c7 expref: 68 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585521:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:0.0:1788535960.585523:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788535960.585527:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd409 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c7 expref: 68 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.585548:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838600, rc 0) 00000100:00100000:0.0:1788535960.585625:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+67:12497:x1875415548398592:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 499us (1330us total) trans 4294967506 rc 301/301 00000100:00100000:0.0:1788535960.592562:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:1.0:1788535960.600787:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.600884:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548398720 00000100:00100000:0.0:1788535960.600893:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548398720 00000100:00100000:0.0:1788535960.600950:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:0.0:1788535960.600959:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+67:12497:x1875415548398720:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788535960.600991:0:6534:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788535960.601099:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+67:12497:x1875415548398720:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 140us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.601106:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:2.0:1788535960.605003:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535960.605209:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548398976 00000100:00100000:3.0:1788535960.605218:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548398976 00000100:00100000:3.0:1788535960.605273:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:3.0:1788535960.605283:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+67:12497:x1875415548398976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535960.605324:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535960.605327:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788535960.605353:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbdd3ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ab expref: 67 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.605370:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535960.605375:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788535960.605387:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd41e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556ce expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535960.605726:0:6535:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788535960.605856:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd425 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.605869:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.605879:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.605924:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd41e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ce expref: 69 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.605939:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd425 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ce expref: 68 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.605947:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807000) 00010000:00010000:3.0:1788535960.605950:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535960.605959:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632ea00, rc 0) 00000100:00100000:3.0:1788535960.606021:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+68:12497:x1875415548398976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 739us (1027us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788535960.606029:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:1.0:1788535960.610428:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.610827:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548399232 00000100:00100000:0.0:1788535960.610836:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548399232 00000100:00100000:0.0:1788535960.610893:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:0.0:1788535960.610903:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005bb297c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+68:12497:x1875415548399232:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788535960.610951:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535960.610976:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd425 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ce expref: 68 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.610995:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807000) 00010000:00010000:0.0:1788535960.611006:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535960.611027:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611057:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611068:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611083:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611090:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611097:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611135:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611142:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611190:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611196:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535960.611201:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611209:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611218:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:0.0:1788535960.611226:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535960.611230:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611238:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd433 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611249:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611255:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611262:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611267:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788535960.611270:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611277:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611284:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xdedf0a8a (ffff900583670a00) 00010000:00010000:0.0:1788535960.611287:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788535960.611290:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.611296:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd43a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdedf0a8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.611363:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005bb297c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+67:12497:x1875415548399232:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 461us (942us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788535960.611375:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:1.0:1788535960.613409:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535960.613637:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548399360 00000100:00100000:3.0:1788535960.613646:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548399360 00000100:00100000:3.0:1788535960.613698:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:3.0:1788535960.613708:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+67:12497:x1875415548399360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535960.613724:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535960.613743:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd441 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556d5 expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.613775:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.613787:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.613801:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.613898:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f400/0xe79af2f39bbdd441 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556d5 expref: 69 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.613914:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556d5 expref: 68 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.613922:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:3.0:1788535960.613924:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788535960.613935:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632e600, rc 0) 00000100:00100000:3.0:1788535960.613987:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+68:12497:x1875415548399360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 282us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535960.613994:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:0.0:1788535960.622129:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.622492:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548399616 00000100:00100000:2.0:1788535960.622503:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548399616 00000100:00100000:2.0:1788535960.622576:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:2.0:1788535960.622587:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+68:12497:x1875415548399616:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788535960.622668:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.622711:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.622723:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788535960.623050:0:10016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1788535960.623060:0:10016:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419426912814ns, next at 420426910377ns, rc = 0 00000004:00010000:2.0:1788535960.623120:0:10016:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000008e161a28 reply state 00000000695666e8 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.623174:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.623186:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:2.0:1788535960.623192:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788535960.623196:0:10016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788535960.623310:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+70:12497:x1875415548399616:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 719us (1185us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788535960.623326:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:2.0:1788535960.627346:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535960.627503:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548399744 00000100:00100000:3.0:1788535960.627511:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548399744 00000100:00100000:3.0:1788535960.627587:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:3.0:1788535960.627598:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+70:12497:x1875415548399744:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788535960.627619:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535960.627637:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556dc expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.627693:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556dc expref: 71 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.627708:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556dc expref: 71 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.627726:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:3.0:1788535960.627730:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788535960.627733:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632e200, rc 0) 00000100:00100000:3.0:1788535960.627787:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+71:12497:x1875415548399744:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 192us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535960.627794:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:3.0:1788535960.643371:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.643520:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548399872 00000100:00100000:1.0:1788535960.643540:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548399872 00000100:00100000:1.0:1788535960.643605:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:1.0:1788535960.643615:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2402:x1875415548399872:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788535960.643807:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+10:2402:x1875415548399872:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 193us (444us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788535960.643828:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:0.0:1788535960.651577:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.651658:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548400128 00000100:00100000:2.0:1788535960.651667:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548400128 00000100:00100000:2.0:1788535960.651719:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788535960.651729:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+71:12497:x1875415548400128:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788535960.651922:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+72:12497:x1875415548400128:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 193us (362us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788535960.651929:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1788535960.655325:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535960.655873:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548400384 00000100:00100000:3.0:1788535960.655882:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548400384 00000100:00100000:3.0:1788535960.655940:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:3.0:1788535960.655964:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+72:12497:x1875415548400384:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788535960.656079:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+72:12497:x1875415548400384:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 117us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535960.656086:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:3.0:1788535960.659450:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.660277:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548400512 00000100:00100000:0.0:1788535960.660287:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548400512 00000100:00100000:0.0:1788535960.660344:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:0.0:1788535960.660354:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+72:12497:x1875415548400512:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535960.660374:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535960.660392:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd45d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556e3 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.660455:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd464 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.660469:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.660480:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535960.660519:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788535960.660549:0:6534:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd464 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.660583:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd45d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556e3 expref: 74 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.660603:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd464 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556e3 expref: 73 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.660630:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:0.0:1788535960.660633:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788535960.660636:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839c00, rc 0) 00000100:00100000:0.0:1788535960.660700:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+73:12497:x1875415548400512:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 346us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.660707:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:0.0:1788535960.671465:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.671573:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548400640 00000100:00100000:1.0:1788535960.671584:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548400640 00000100:00100000:1.0:1788535960.671641:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:1.0:1788535960.671650:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+10:2400:x1875415548400640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535960.671669:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535960.671688:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556ea expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788535960.671713:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae498, blocks: 0x0 00010000:00010000:1.0:1788535960.671732:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1788535960.671737:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535960.671747:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ea expref: 11 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.671764:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ea expref: 11 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.671778:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f400, rc 0) 00000100:00100000:1.0:1788535960.671837:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+11:2400:x1875415548400640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 188us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.671844:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:2.0:1788535960.676332:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.676505:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548400896 00000100:00100000:1.0:1788535960.676515:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548400896 00000100:00100000:1.0:1788535960.676610:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:1.0:1788535960.676621:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+73:12497:x1875415548400896:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788535960.676745:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+73:12497:x1875415548400896:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 127us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.676754:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:3.0:1788535960.679379:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.679643:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548401024 00000100:00100000:1.0:1788535960.679652:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548401024 00000100:00100000:1.0:1788535960.679710:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:1.0:1788535960.679719:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+11:12497:x1875415548401024:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788535960.679737:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788535960.679752:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556f1 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.679779:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ea expref: 12 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.679788:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535960.679791:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788535960.679797:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.679826:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ea expref: 12 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.679839:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ea expref: 12 pid: 8448 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535960.679851:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8447:1875415569418624:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788535960.680026:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788535960.688213:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8447:1875415569418624:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535960.688250:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.688429:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f600, rc 0) 00000100:00100000:1.0:1788535960.688493:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+12:12497:x1875415548401024:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 8774us (9125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.688503:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:3.0:1788535960.688964:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.690019:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548401152 00000100:00100000:1.0:1788535960.690029:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548401152 00010000:00010000:1.0:1788535960.690082:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ea expref: 12 pid: 8448 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.690358:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:0.0:1788535960.690371:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+12:2402:x1875415548401152:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535960.690386:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535960.690408:0:10351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ea expref: 12 pid: 8448 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.690423:0:10351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ea expref: 12 pid: 8448 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.690449:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8b619d/0xe79af2f39bbdd46b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ea expref: 12 pid: 8448 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.690469:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535960.690473:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535960.690481:0:10351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.690512:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.690576:0:10351:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.690590:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10351:1875415569418752:192.168.203.13@tcp:105: 00000100:00100000:0.0:1788535960.690668:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff900590741540 going to sleep for 11 seconds 00000100:00100000:0.0:1788535960.696726:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10351:1875415569418752:192.168.203.13@tcp:105: 00010000:00010000:0.0:1788535960.696760:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535960.696813:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+11:2402:x1875415548401152:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 6446us (7849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.696824:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:2.0:1788535960.698005:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.698386:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548401280 00000100:00100000:0.0:1788535960.698394:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548401280 00002000:00100000:1.0:1788535960.698498:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9004888de300 x1875415548401280/t0(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:616/0 lens 504/0 e 0 to 0 dl 1788535971 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788535960.698509:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9004888de300 with x1875415548401280 ext(0->12) 00002000:00010000:1.0:1788535960.698515:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9004888de300 00000100:00100000:1.0:1788535960.698633:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788535960.698642:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+11:2402:x1875415548401280:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788535960.699702:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+13:2402:x1875415548401280:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 1056us (1697us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788535960.699712:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00002000:00100000:1.0:1788535960.699720:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9004888de300 x1875415548401280/t4294967321(0) o4->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:616/0 lens 504/448 e 0 to 0 dl 1788535971 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788535960.699736:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9004888de300 with x1875415548401280 ext(0->12) 00002000:00010000:1.0:1788535960.699740:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9004888de300 00000100:00100000:3.0:1788535960.714585:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.714724:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548401408 00000100:00100000:2.0:1788535960.714734:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548401408 00000100:00100000:2.0:1788535960.714793:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 244 00000100:00100000:2.0:1788535960.714804:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+73:12497:x1875415548401408:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788535960.719353:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1788535960.719370:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:2.0:1788535960.719417:0:6512:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788535960.719442:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90059d4cb900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788535960.719447:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90059e0e3200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90059d4cb600 00000020:00080000:2.0:1788535960.719450:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90059e0e3100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff900487451e00 00000020:00080000:2.0:1788535960.719494:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90059d4cbb40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788535960.719498:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9005b7bb4b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90059d4cbc00 00000020:00080000:2.0:1788535960.719501:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9005b7bb4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff900488106a00 00000020:00080000:2.0:1788535960.719539:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1788535960.719543:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535960.719563:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569418880:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788535960.719602:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788535960.719640:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535960.719684:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569419008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788535960.719707:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535960.719741:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569418880 00000100:00100000:3.0:1788535960.719748:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569418880 00000100:00100000:3.0:1788535960.719791:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569419008 00000100:00100000:3.0:1788535960.719794:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569419008 00000100:00100000:3.0:1788535960.719818:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788535960.719826:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3662:x1875415569418880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788535960.719848:0:8446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1788535960.719874:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.719894:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655649 expref: 12 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.719903:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788535960.719920:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788535960.719926:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.719955:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655649 expref: 12 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.719970:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655649 expref: 12 pid: 8446 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535960.719982:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488920e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8446:1875415569419136:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535960.720044:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058ddab300 going to sleep for 11 seconds 00010000:00010000:1.0:1788535960.720047:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788535960.720058:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788535960.720060:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720069:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535960.720076:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1788535960.720078:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535960.720085:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535960.720088:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569419008:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788535960.720101:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720117:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9005b7b03200) 00010000:00010000:1.0:1788535960.720120:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535960.720125:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720131:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd177 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720178:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720186:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720199:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720204:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535960.720207:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720214:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720224:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff900487807e00) 00010000:00010000:1.0:1788535960.720227:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535960.720230:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720237:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd21f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720256:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720262:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720268:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720273:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535960.720276:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720294:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720305:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900487807100) 00000100:00100000:0.0:1788535960.720307:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788535960.720308:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535960.720314:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.720317:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569419264:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788535960.720325:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd29d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720342:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720349:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.720355:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788535960.720360:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720366:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620ee00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535960.720370:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720376:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720386:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900487807100) 00000100:00100000:0.0:1788535960.720386:0:10017:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00010000:00010000:1.0:1788535960.720393:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535960.720396:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.720396:0:10017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:1.0:1788535960.720424:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620ee00/0xe79af2f39bbdd2c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720459:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720466:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720471:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720476:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620fa00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535960.720480:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720501:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.720505:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569419264 00010000:00010000:1.0:1788535960.720511:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00000100:00100000:0.0:1788535960.720511:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569419264 00010000:00010000:1.0:1788535960.720518:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788535960.720521:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720527:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fa00/0xe79af2f39bbdd392 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720540:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720546:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720560:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720579:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788535960.720582:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720589:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720599:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:1.0:1788535960.720601:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788535960.720604:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.720610:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbdd44f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.720630:0:14733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788535960.720639:0:14733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3660:x1875415569419264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788535960.720652:0:14733:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:0.0:1788535960.720682:0:14733:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ae497, atime: 0x6a9ae497, ctime: 0x6a9ae497, blocks: 0x8 00010000:00010000:0.0:1788535960.720688:0:14733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.720698:0:14733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1788535960.720701:0:14733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535960.720707:0:14733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.720721:0:14733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.720729:0:14733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.720736:0:14733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.720758:0:14733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788535960.720864:0:14733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3660:x1875415569419264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 226us (510us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788535960.720871:0:14733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1788535960.720910:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff900488966a00/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788535960.720915:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569419264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788535960.720996:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12497:x1875415548401408:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 6192us (6428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535960.721005:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 244 00010000:00010000:1.0:1788535960.721635:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535960.721643:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.721651:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788535960.721655:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.721664:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.721703:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.721711:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd480 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.721730:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535960.721732:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535960.721733:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788535960.723639:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788535960.723647:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788535960 00002000:00010000:3.0:1788535960.723650:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788535960.723652:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788535960 -> 1788535960 00002000:00010000:3.0:1788535960.723655:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788535960.723738:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3660:x1875415569419008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3650us (4025us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788535960.723748:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788535960.724318:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff900488921500/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788535960.724326:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569419008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788535960.728609:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.728647:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.728741:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548401536 00000100:00100000:0.0:1788535960.728763:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548401536 00000100:00100000:0.0:1788535960.728819:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1788535960.728829:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+13:2401:x1875415548401536:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788535960.729485:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488920e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8446:1875415569419136:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788535960.729511:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535960.730815:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548401664 00000100:00100000:1.0:1788535960.730826:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548401664 00010000:00010000:1.0:1788535960.730865:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655649 expref: 14 pid: 8446 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535960.730917:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:1.0:1788535960.730926:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+14:2401:x1875415548401664:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535960.730939:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535960.730946:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655649 expref: 14 pid: 8446 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.730959:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655649 expref: 14 pid: 8446 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.730990:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69de1d7/0xe79af2f39bbdd22d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655649 expref: 14 pid: 8446 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.731021:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535960.731026:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535960.731033:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.731042:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.731075:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788535960.731249:0:8446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.731263:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.731285:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.731294:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.731312:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788535960.731348:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+13:2401:x1875415548401664:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 421us (2698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.731357:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00010000:00010000:0.0:1788535960.731436:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535960.731444:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.731453:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788535960.731457:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.731468:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.731481:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.731489:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd479 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535960.731500:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3662:x1875415569418880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11673us (11859us total) trans 4294967323 rc 0/0 00010000:00010000:0.0:1788535960.731509:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535960.731510:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1788535960.731512:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535960.731516:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788535960.732757:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1788535960.732768:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1788535960.735174:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2401:x1875415548401536:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 6337us (6567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.735187:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000004:00080000:1.0:1788535960.735413:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff900488922300/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788535960.735422:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569418880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788535960.747223:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:1.0:1788535960.748619:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535960.750398:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548401920 00000100:00100000:0.0:1788535960.750429:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548401920 00000100:00100000:0.0:1788535960.750554:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 245 00000100:00100000:0.0:1788535960.750575:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12497:x1875415548401920:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788535960.750636:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788535960.750688:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbdd464 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556e3 expref: 21 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.750715:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:0.0:1788535960.750721:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788535960.750757:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.750771:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.750781:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788535960.750893:0:6534:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000002bb9c6b8 reply state 00000000fed04697 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.750905:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.750911:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:0.0:1788535960.750914:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788535960.750917:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788535960.751020:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+22:12497:x1875415548401920:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 455us (3807us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1788535960.751028:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 245 00000100:00100000:2.0:1788535960.757887:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.758418:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548402048 00000100:00100000:1.0:1788535960.758429:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548402048 00000100:00100000:1.0:1788535960.758486:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:1.0:1788535960.758495:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2400:x1875415548402048:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788535960.758656:0:8448:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788535960.758660:0:8448:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788535960 -> 1788535960 00002000:00010000:1.0:1788535960.758663:0:8448:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788535959 00002000:00010000:1.0:1788535960.758666:0:8448:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788535960 -> 1788535960 00002000:00010000:1.0:1788535960.758668:0:8448:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788535960.758914:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2400:x1875415548402048:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 419us (1036us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788535960.758923:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1788535960.778820:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535960.778977:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548402304 00000100:00100000:3.0:1788535960.778987:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548402304 00000100:00100000:3.0:1788535960.779059:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:3.0:1788535960.779069:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+22:12497:x1875415548402304:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788535960.779140:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.779179:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556d5 expref: 22 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.779189:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.779220:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556d5 expref: 22 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.779233:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556d5 expref: 22 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535960.779247:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488922a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569419392:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535960.779388:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058ddab300 going to sleep for 11 seconds 00000100:00100000:3.0:1788535960.790014:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488922a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569419392:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535960.790043:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.791487:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.791791:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548402432 00000100:00100000:1.0:1788535960.791799:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548402432 00010000:00010000:1.0:1788535960.791837:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556d5 expref: 23 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535960.791879:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:1.0:1788535960.791891:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+23:2401:x1875415548402432:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535960.791906:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535960.791913:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556d5 expref: 23 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.791926:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556d5 expref: 23 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.791949:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd448 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556d5 expref: 23 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.791965:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:1.0:1788535960.791970:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.791980:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.791989:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.792038:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535960.792099:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+22:2401:x1875415548402432:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 209us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.792106:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00010000:00010000:3.0:1788535960.792243:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.792252:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.792314:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.792321:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.792328:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.792334:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535960.792338:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.792346:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.792357:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:3.0:1788535960.792360:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788535960.792364:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.792370:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd48e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535960.792414:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12497:x1875415548402304:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 13345us (13603us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788535960.792422:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:2.0:1788535960.799037:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.799288:0:14733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548402560 00000100:00100000:0.0:1788535960.799299:0:14733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548402560 00000100:00100000:0.0:1788535960.799356:0:14733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1788535960.799366:0:14733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2399:x1875415548402560:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788535960.799409:0:14733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.799429:0:14733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.799438:0:14733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788535960.799442:0:14733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788535960.799447:0:14733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.799482:0:14733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.799497:0:14733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 8 pid: 8447 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.799510:0:14733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488967100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14733:1875415569419520:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535960.799611:0:14733:0:(client.c:2716:ptlrpc_set_wait()) set ffff900590741cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535960.803184:0:14733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488967100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14733:1875415569419520:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535960.803227:0:14733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535960.804215:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.804315:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548402688 00000100:00100000:1.0:1788535960.804324:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548402688 00010000:00010000:1.0:1788535960.804363:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 9 pid: 8447 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535960.804397:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:1.0:1788535960.804406:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+9:2401:x1875415548402688:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535960.804420:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535960.804439:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 9 pid: 8447 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.804452:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 9 pid: 8447 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.804473:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050ef086e/0xe79af2f39bbdd472 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f1 expref: 9 pid: 8447 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.804490:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535960.804494:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788535960.804501:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.804537:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.804579:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535960.804646:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2401:x1875415548402688:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 240us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.804653:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00010000:00010000:2.0:1788535960.805906:0:14733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.805920:0:14733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.805962:0:14733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.805970:0:14733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.805978:0:14733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.805985:0:14733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788535960.805989:0:14733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.805998:0:14733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.806012:0:14733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.806020:0:14733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098736fac/0xe79af2f39bbdd495 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535960.806103:0:14733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2399:x1875415548402560:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 6734us (7072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535960.806113:0:14733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:2.0:1788535960.821901:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.822190:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548402944 00000100:00100000:0.0:1788535960.822199:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548402944 00000100:00100000:0.0:1788535960.822251:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:0.0:1788535960.822261:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+21:12497:x1875415548402944:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788535960.822336:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.822353:0:10016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165569d expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.822364:0:10016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.822397:0:10016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165569d expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535960.822410:0:10016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165569d expref: 21 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535960.822424:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488967100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569419648:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788535960.822504:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff900590741cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788535960.827371:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488967100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569419648:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788535960.827400:0:10016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535960.829284:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.829713:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548403072 00000100:00100000:1.0:1788535960.829722:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548403072 00010000:00010000:1.0:1788535960.829761:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165569d expref: 22 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535960.829790:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:1.0:1788535960.829799:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+22:2401:x1875415548403072:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535960.829812:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535960.829818:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165569d expref: 22 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.829830:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165569d expref: 22 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.829852:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838000/0xe79af2f39bbdd38b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165569d expref: 22 pid: 6535 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.829870:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:1.0:1788535960.829890:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c0 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.829899:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.829906:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.829913:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.829948:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535960.830004:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+21:2401:x1875415548403072:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 204us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.830011:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00010000:00010000:2.0:1788535960.830822:0:10016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.830834:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.830996:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.831009:0:10016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556dc expref: 21 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.831016:0:10016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.831045:0:10016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556dc expref: 21 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.831058:0:10016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556dc expref: 21 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535960.831070:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888df800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569419776:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788535960.831177:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788535960.838100:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888df800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569419776:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788535960.838129:0:10016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535960.840550:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.840665:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548403200 00000100:00100000:1.0:1788535960.840674:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548403200 00010000:00010000:1.0:1788535960.840717:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556dc expref: 22 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535960.840757:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:1.0:1788535960.840767:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+22:2401:x1875415548403200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535960.840781:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535960.840787:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556dc expref: 22 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.840800:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556dc expref: 22 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.840835:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd456 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556dc expref: 22 pid: 10112 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.840852:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:1.0:1788535960.840857:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.840877:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.840884:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.840911:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535960.840969:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+21:2401:x1875415548403200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 203us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.840976:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00010000:00010000:3.0:1788535960.842027:0:10016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.842039:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788535960.843022:0:10016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788535960.843269:0:10016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788535960.843311:0:10016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788535960.843388:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10016:1875415569419904:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788535960.843442:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535960.843540:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788535960.844830:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569419904 00000100:00100000:0.0:1788535960.844841:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569419904 00000100:00100000:0.0:1788535960.845062:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788535960.845073:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10016:x1875415569419904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788535960.847321:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10016:x1875415569419904:12345-0@lo:1000:mdt00_003.0 Request processed in 2241us (3868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.847336:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788535960.847430:0:10016:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788535960.847436:0:10016:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788535960.847456:0:10016:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff900488921500, transno 4294967322 00000100:00100000:2.0:1788535960.847480:0:10016:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff900488922300 x1875415569418880/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788535976 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535960.847493:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10016:1875415569419904:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788535960.847672:0:10016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788535960.847755:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10016:1875415569420032:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788535960.847803:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535960.861854:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1a5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788535960.865801:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569420032 00000100:00100000:1.0:1788535960.865815:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569420032 00000100:00100000:1.0:1788535960.865879:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788535960.865888:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10016:x1875415569420032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788535960.866084:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10016:x1875415569420032:12345-0@lo:1000:mdt00_003.0 Request processed in 196us (18279us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788535960.866092:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788535960.866258:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10016:1875415569420032:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788535960.866308:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866318:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866326:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866332:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535960.866337:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866344:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866359:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:2.0:1788535960.866375:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535960.866380:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866386:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067200/0xe79af2f39bbdd4a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866412:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866419:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866425:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866430:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535960.866432:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866443:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866452:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535960.866454:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535960.866461:0:10016:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c0 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866473:0:10016:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c0 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866482:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c0 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.866529:0:10016:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c0 expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535960.866542:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569420160:192.168.203.13@tcp:105: 00000100:00100000:2.0:1788535960.866627:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535960.870655:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10016:1875415569420160:192.168.203.13@tcp:105: 00010000:00010000:2.0:1788535960.870695:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870707:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f800/0xe79af2f39bbdd3e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870740:0:10016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870753:0:10016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870764:0:10016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870774:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870780:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870786:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870807:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535960.870811:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870818:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870828:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535960.870831:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535960.870834:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870840:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4aa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870849:0:10016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870854:0:10016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870859:0:10016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870864:0:10016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535960.870866:0:10016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870872:0:10016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870889:0:10016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535960.870891:0:10016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788535960.870895:0:10016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.870901:0:10016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838400/0xe79af2f39bbdd49c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535960.871048:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12497:x1875415548402944:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 48786us (49154us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788535960.871059:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 247 00000020:00080000:2.0:1788535960.871069:0:10016:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788535960.871831:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.872116:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548403328 00000100:00100000:2.0:1788535960.872124:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548403328 00000100:00100000:2.0:1788535960.872198:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:2.0:1788535960.872208:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12495:x1875415548403328:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:2.0:1788535960.872303:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12495:x1875415548403328:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 96us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535960.872310:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000040:00080000:0.0:1788535960.872840:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535960.872847:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535960.873381:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788535960.873389:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788535960.875860:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535960.876083:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548403584 00000100:00100000:0.0:1788535960.876093:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548403584 00000100:00100000:0.0:1788535960.876192:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 248 00000100:00100000:0.0:1788535960.876202:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12495:x1875415548403584:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:0.0:1788535960.876363:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788535960.876432:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12495:x1875415548403584:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 230us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535960.876439:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 248 00000100:00100000:1.0:1788535960.882862:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535960.890930:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548403840 00000100:00100000:2.0:1788535960.890944:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548403840 00000100:00100000:2.0:1788535960.891008:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1788535960.891017:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+24:12497:x1875415548403840:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788535960.891289:0:6537:0:(mdd_object.c:4338:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788535960.891323:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:2.0:1788535960.891355:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.891384:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.891397:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.891405:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.891412:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.891418:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535960.891431:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788535960.891514:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+26:12497:x1875415548403840:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 497us (8660us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788535960.891521:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000020:00080000:2.0:1788535960.891526:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788535960.892345:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535960.892353:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.892368:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066800 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788535960.892372:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.892379:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.892394:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:1.0:1788535960.892397:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788535960.892402:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.892407:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066800/0xe79af2f39bbdd4b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.892419:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535960.892420:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535960.892422:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535960.903360:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535960.903445:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548403968 00000100:00100000:3.0:1788535960.903454:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548403968 00000100:00100000:3.0:1788535960.903512:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:3.0:1788535960.903522:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+26:12499:x1875415548403968:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788535960.903544:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788535960.903576:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd4b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556f8 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903636:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903651:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903662:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903674:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903709:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903717:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903789:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903800:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b9 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903809:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903842:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b9 expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.903856:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b9 expref: 27 pid: 6534 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535960.903884:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569420288:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788535960.903969:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058ddab300 going to sleep for 11 seconds 00000100:00100000:3.0:1788535960.906675:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.906797:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875415569420288:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788535960.906825:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535960.907030:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548404224 00000100:00100000:2.0:1788535960.907037:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548404224 00000100:00100000:2.0:1788535960.907091:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788535960.907101:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+28:6170:x1875415548404224:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788535960.907331:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+29:6170:x1875415548404224:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 231us (664us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788535960.907339:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1788535960.909801:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535960.909950:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548404352 00000100:00100000:1.0:1788535960.909959:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548404352 00010000:00010000:1.0:1788535960.909995:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b9 expref: 29 pid: 6534 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535960.910035:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:1.0:1788535960.910052:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+29:2401:x1875415548404352:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535960.910066:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535960.910073:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b9 expref: 29 pid: 6534 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.910085:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b9 expref: 29 pid: 6534 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.910106:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839e00/0xe79af2f39bbdd3d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556b9 expref: 29 pid: 6534 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.910125:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:1.0:1788535960.910130:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.910139:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.910181:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535960.910215:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535960.910258:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+28:2401:x1875415548404352:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 208us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535960.910265:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00010000:00010000:3.0:1788535960.910411:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910419:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788535960.910477:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788535960.910481:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788535960.910500:0:6533:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910511:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910521:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910527:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910534:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910539:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535960.910543:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910550:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910559:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:3.0:1788535960.910561:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535960.910577:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910583:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f000/0xe79af2f39bbdd4bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910607:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910614:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910619:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910625:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632ea00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535960.910628:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910645:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910654:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff900487807000) 00010000:00010000:3.0:1788535960.910656:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535960.910659:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910665:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632ea00/0xe79af2f39bbdd4c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910704:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632fe00/0xe79af2f39bbdd4b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f8 expref: 28 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910718:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f8 expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535960.910737:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:3.0:1788535960.910739:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788535960.910742:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632e200, rc 0) 00000100:00100000:3.0:1788535960.910783:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12499:x1875415548403968:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 7262us (7432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535960.910790:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 249 00000040:00080000:0.0:1788535961.658269:0:14771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788535961.658279:0:14771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788535961.658312:0:14771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788535961.658320:0:14771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788535961.711361:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788535961.711393:0:8441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:0.0:1788535961.776541:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788535961.901571:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788535961.901579:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788535961.901601:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788535961.901608:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788535961.901733:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569420416:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788535961.901830:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005ac8636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788535961.908509:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875415569420416:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788535961.911743:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535961.912075:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548404480 00000100:00100000:2.0:1788535961.912084:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548404480 00000100:00100000:2.0:1788535961.912166:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 250 00000100:00100000:2.0:1788535961.912177:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12511:x1875415548404480:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788535961.912209:0:10016:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788535961.912326:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12511:x1875415548404480:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 151us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535961.912335:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 250 00000100:00080000:3.0:1788535961.916524:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535961.923266:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535961.925268:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548404736 00000100:00100000:0.0:1788535961.925282:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548404736 00000100:00100000:0.0:1788535961.925403:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 251 00000100:00100000:0.0:1788535961.925414:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+27:12511:x1875415548404736:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788535961.925432:0:10112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788535961.925451:0:10112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd4d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16556ff expref: -99 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535961.925548:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd4db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535961.925574:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535961.925586:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd4db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788535961.925597:0:10112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788535961.925690:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbdd4d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ff expref: 30 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535961.925710:0:10112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd4db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ff expref: 29 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535961.925718:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:0.0:1788535961.925722:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788535961.925725:0:10112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839600, rc 0) 00000100:00100000:0.0:1788535961.925786:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+29:12511:x1875415548404736:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 373us (2528us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788535961.925793:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 251 00000100:00100000:1.0:1788535961.938554:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535961.938666:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535961.938819:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548404992 00000100:00100000:3.0:1788535961.938828:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548404992 00000100:00100000:3.0:1788535961.938890:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 252 00000100:00100000:3.0:1788535961.938900:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+29:12511:x1875415548404992:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788535961.938972:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.938989:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.939000:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.939142:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.939173:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.939180:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.939192:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535961.939196:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.939203:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.939214:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:3.0:1788535961.939216:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788535961.939221:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.939227:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e600/0xe79af2f39bbdd4e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535961.939332:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+30:12511:x1875415548404992:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 433us (786us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788535961.939340:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 252 00000100:00100000:2.0:1788535961.939650:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548405120 00000100:00100000:2.0:1788535961.939656:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548405120 00000100:00100000:3.0:1788535961.939858:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788535961.939867:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+30:2402:x1875415548405120:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535961.939878:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535961.939893:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839600/0xe79af2f39bbdd4db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556ff expref: 30 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535961.939905:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:3.0:1788535961.939909:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535961.939942:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+29:2402:x1875415548405120:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 76us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535961.939957:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000040:00080000:3.0:1788535961.940324:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535961.940329:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535961.941875:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788535961.941888:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788535961.948463:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535961.950535:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548405376 00000100:00100000:2.0:1788535961.950548:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548405376 00000100:00100000:2.0:1788535961.950655:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1788535961.950665:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+29:12511:x1875415548405376:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788535961.950880:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+30:12511:x1875415548405376:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 215us (2425us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788535961.950889:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1788535962.541003:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569420672:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541090:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541182:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569421184:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541205:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541226:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569421696:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541246:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541499:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788535962.541506:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569420544:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541535:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541569:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569421056:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541593:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541607:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569421568:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541624:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541638:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569422080:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541664:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541690:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569420928:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541711:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541726:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569421440:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541745:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541759:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569421952:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541778:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541794:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788535962.541799:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569420800:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541820:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541837:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569421312:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541868:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541883:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569421824:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.541902:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535962.541924:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569420544 00000100:00100000:0.0:1788535962.541931:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569420544 00000100:00100000:0.0:1788535962.541971:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788535962.541981:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569420544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.542266:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569421056 00000100:00100000:1.0:1788535962.542271:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569421056 00000100:00100000:1.0:1788535962.542296:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569420800 00000100:00100000:1.0:1788535962.542298:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569420800 00000100:00100000:1.0:1788535962.542309:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788535962.542315:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569421056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.542372:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569421056:12345-0@lo:400:kworker.0 Request processed in 57us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535962.542388:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788535962.542408:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788535962.542414:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569420800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.542447:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569420800:12345-0@lo:400:kworker.0 Request processed in 34us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535962.542453:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788535962.542483:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569421568 00000100:00100000:1.0:1788535962.542486:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569421568 00000100:00100000:1.0:1788535962.542515:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569422080 00000100:00100000:1.0:1788535962.542517:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569422080 00000100:00100000:1.0:1788535962.542527:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569421440 00000100:00100000:1.0:1788535962.542529:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569421440 00000100:00100000:1.0:1788535962.542538:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569421952 00000100:00100000:1.0:1788535962.542541:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569421952 00000100:00100000:1.0:1788535962.542566:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788535962.542572:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569421568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.542603:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569421568:12345-0@lo:400:kworker.0 Request processed in 31us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535962.542610:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788535962.542631:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788535962.542637:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3663:x1875415569422080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.542674:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3663:x1875415569422080:12345-0@lo:400:kworker.0 Request processed in 37us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535962.542680:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788535962.542690:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788535962.542696:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569421440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.542721:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569421440:12345-0@lo:400:kworker.0 Request processed in 25us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535962.542726:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788535962.542736:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788535962.542741:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569421952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.542766:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569421952:12345-0@lo:400:kworker.0 Request processed in 25us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535962.542772:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788535962.542791:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569420672 00000100:00100000:1.0:1788535962.542795:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569420672 00000100:00100000:1.0:1788535962.542812:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569421184 00000100:00100000:1.0:1788535962.542815:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569421184 00000100:00100000:1.0:1788535962.542826:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569421696 00000100:00100000:1.0:1788535962.542829:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569421696 00000100:00100000:1.0:1788535962.542840:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569420928 00000100:00100000:1.0:1788535962.542843:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569420928 00000100:00100000:1.0:1788535962.542852:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569421312 00000100:00100000:1.0:1788535962.542855:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569421312 00000100:00100000:1.0:1788535962.542865:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569421824 00000100:00100000:1.0:1788535962.542868:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569421824 00000100:00100000:1.0:1788535962.542879:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788535962.542885:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569420672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.542924:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569420672:12345-0@lo:400:kworker.0 Request processed in 39us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535962.542930:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788535962.542941:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788535962.542946:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569421184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.542969:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569421184:12345-0@lo:400:kworker.0 Request processed in 23us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535962.542974:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788535962.542983:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788535962.542989:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569421696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535962.543028:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569421696:12345-0@lo:400:kworker.0 Request processed in 39us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535962.543034:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788535962.543563:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569420544:12345-0@lo:400:kworker.0 Request processed in 1573us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535962.543572:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788535962.543630:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569420800:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.543641:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569421440:0@lo:400:kworker.0 00000100:00100000:0.0:1788535962.543775:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569421952:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.543933:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788535962.543946:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569420928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.544011:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569420928:12345-0@lo:400:kworker.0 Request processed in 69us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.544017:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788535962.544031:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788535962.544048:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569421312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.544086:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569421312:12345-0@lo:400:kworker.0 Request processed in 50us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.544092:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788535962.544103:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788535962.544109:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569421824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.544136:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569421824:12345-0@lo:400:kworker.0 Request processed in 27us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535962.544141:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00080000:2.0:1788535962.544179:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb75c00 x1875415569421312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535962.544190:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569421312:0@lo:400:kworker.0 00010000:00080000:2.0:1788535962.544200:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb75880 x1875415569421824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535962.544208:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569421824:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.544217:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569420928:0@lo:400:kworker.0 00000100:00080000:2.0:1788535962.548390:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535962.548400:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788535962.548404:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535962.548407:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535962.548491:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569420544:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.548508:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569421056:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.548519:0:3663:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788535962.548525:0:3663:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1788535962.548574:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90058ad0d180, transno 4294967308 00000004:00080000:2.0:1788535962.548595:0:3663:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788535962.548606:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff900488966a00, transno 4294967311 00000100:00100000:2.0:1788535962.548612:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569421568:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.548628:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569422080:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.548639:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569420672:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.548662:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569421184:0@lo:400:kworker.0 00000100:00100000:2.0:1788535962.548675:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569421696:0@lo:400:kworker.0 00010000:00010000:1.0:1788535962.803186:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535963.060183:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535963.060204:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569422208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535963.060261:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535963.060394:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569422208 00000100:00100000:3.0:1788535963.060401:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569422208 00000100:00100000:3.0:1788535963.060457:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788535963.060466:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569422208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535963.060492:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788535963.060538:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569422208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535963.060545:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788535963.060598:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569422208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535963.062661:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788535963.062682:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569422336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535963.062739:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535963.063050:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569422336 00000100:00100000:1.0:1788535963.063057:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569422336 00000100:00100000:1.0:1788535963.063105:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788535963.063113:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875415569422336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535963.063132:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788535963.063208:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875415569422336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535963.063216:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788535963.063353:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569422336:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788535963.507871:0:14822:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535963.507880:0:14822:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535963.507910:0:14822:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788535963.507916:0:14822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788535963.705658:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535963.705727:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548405632 00000100:00100000:2.0:1788535963.705736:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548405632 00000100:00100000:2.0:1788535963.705816:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 253 00000100:00100000:2.0:1788535963.705826:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+30:12531:x1875415548405632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788535963.705855:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535963.705880:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd4f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655706 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.705987:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdd4f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.706003:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdd4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.706035:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdd4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535963.706047:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788535963.706187:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067800/0xe79af2f39bbdd4f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655706 expref: 33 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.706207:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdd4f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655706 expref: 32 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.706216:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535963.706219:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788535963.706223:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066200, rc 0) 00000100:00100000:2.0:1788535963.706277:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+32:12531:x1875415548405632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 452us (629us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788535963.706285:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 253 00000100:00080000:3.0:1788535963.706657:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535963.718717:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535963.720268:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548405760 00000100:00100000:2.0:1788535963.720281:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548405760 00000100:00100000:2.0:1788535963.720341:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 254 00000100:00100000:2.0:1788535963.720352:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+32:12531:x1875415548405760:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1788535963.720419:0:10112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.720436:0:10112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.720449:0:10112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.720495:0:10112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.720503:0:10112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.720509:0:10112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.720514:0:10112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788535963.720519:0:10112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.720536:0:10112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.720556:0:10112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535963.720559:0:10112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788535963.720564:0:10112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.720570:0:10112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbdd505 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788535963.720644:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+32:12531:x1875415548405760:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 293us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535963.720652:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 254 00010000:00010000:1.0:1788535963.820468:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535963.862091:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535963.862367:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548405888 00000100:00100000:2.0:1788535963.862376:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548405888 00000100:00100000:2.0:1788535963.862449:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:2.0:1788535963.862472:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548405888:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788535963.862488:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535963.862506:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdd50c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165570d expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788535963.862530:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ae498, atime: 0x6a9ae497, ctime: 0x6a9ae498, blocks: 0x8 00010000:00010000:2.0:1788535963.862560:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788535963.862566:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788535963.862576:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdd50c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165570d expref: 8 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.862594:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdd50c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165570d expref: 8 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535963.862607:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066c00, rc 0) 00000100:00100000:2.0:1788535963.862661:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2402:x1875415548405888:12345-192.168.203.13@tcp:101:cat.0 Request processed in 191us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535963.862667:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00080000:3.0:1788535963.862917:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535963.871880:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535963.871963:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548406016 00000100:00100000:0.0:1788535963.871970:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548406016 00002000:00100000:0.0:1788535963.872012:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff90059fb74000 x1875415548406016/t0(0) o3->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:619/0 lens 488/0 e 0 to 0 dl 1788535974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535963.872035:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fb74000 with x1875415548406016 ext(0->4095) 00002000:00010000:0.0:1788535963.872041:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fb74000 00000100:00100000:0.0:1788535963.872077:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788535963.872087:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2400:x1875415548406016:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:0.0:1788535963.872287:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2400:x1875415548406016:12345-192.168.203.13@tcp:3:cat.0 Request processed in 200us (414us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788535963.872294:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00002000:00100000:0.0:1788535963.872300:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff90059fb74000 x1875415548406016/t0(0) o3->b9ef506c-5095-4495-a34a-e3b5845d008a@192.168.203.13@tcp:619/0 lens 488/4536 e 0 to 0 dl 1788535974 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788535963.872308:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90059fb74000 with x1875415548406016 ext(0->4095) 00002000:00010000:0.0:1788535963.872311:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90059fb74000 00000100:00100000:1.0:1788535964.077421:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535964.077460:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569422464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788535964.077523:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535964.077655:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569422464 00000100:00100000:2.0:1788535964.077662:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569422464 00000100:00100000:2.0:1788535964.077724:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788535964.077734:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569422464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788535964.077762:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788535964.077806:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569422464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535964.077822:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788535964.077933:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535964.077943:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569422592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535964.077974:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535964.078001:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569422592 00000100:00100000:3.0:1788535964.078005:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569422592 00000100:00100000:3.0:1788535964.078031:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788535964.078045:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005c1af6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569422592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788535964.078055:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535964.078086:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005c1af6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569422592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535964.078092:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788535964.078333:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569422592:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788535964.078449:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535964.078475:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569422464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535964.588462:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569422720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788535964.588523:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535964.588659:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569422720 00000100:00100000:0.0:1788535964.588666:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569422720 00000100:00100000:0.0:1788535964.588723:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788535964.588732:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569422720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788535964.588764:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535964.588813:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569422720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535964.588820:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788535964.588923:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569422720:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535964.852178:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535965.100961:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535965.100987:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569422848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535965.101060:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535965.101130:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569422848 00000100:00100000:3.0:1788535965.101139:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569422848 00000100:00100000:3.0:1788535965.101199:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788535965.101207:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569422848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535965.101236:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788535965.101282:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569422848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535965.101289:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788535965.101339:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569422848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535965.581239:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535965.581271:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535965.581422:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548406272 00000100:00100000:3.0:1788535965.581432:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548406272 00000100:00100000:3.0:1788535965.581506:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 316 00000100:00100000:3.0:1788535965.581517:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+32:2400:x1875415548406272:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:1.0:1788535965.581736:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535965.581807:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+32:2400:x1875415548406272:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 292us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535965.581816:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 316 00000100:00100000:3.0:1788535965.582594:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535965.582632:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535965.582671:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535965.582690:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535965.582767:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548406784 00000100:00100000:1.0:1788535965.582773:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548406784 00000100:00100000:1.0:1788535965.582816:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548406400 00000100:00100000:1.0:1788535965.582819:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548406400 00000100:00100000:1.0:1788535965.582842:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 317 00000100:00100000:1.0:1788535965.582850:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548406784:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535965.582897:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548406784:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 48us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535965.582903:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 317 00000100:00100000:1.0:1788535965.582917:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 318 00000100:00100000:1.0:1788535965.582924:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548406400:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535965.582944:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548406400:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535965.582950:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 318 00000100:00100000:2.0:1788535965.583199:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548406144 00000100:00100000:2.0:1788535965.583204:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548406144 00000100:00100000:2.0:1788535965.583237:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 387 00000100:00100000:2.0:1788535965.583244:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2400:x1875415548406144:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535965.583272:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2400:x1875415548406144:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535965.583278:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 387 00000100:00080000:1.0:1788535965.584056:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788535965.584061:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535965.590265:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535965.590335:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548406912 00000100:00100000:1.0:1788535965.590345:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548406912 00000100:00100000:0.0:1788535965.592042:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548406528 00000100:00100000:0.0:1788535965.592054:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548406528 00000100:00100000:1.0:1788535965.592239:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 319 00000100:00100000:1.0:1788535965.592253:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548406912:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535965.592330:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2400:x1875415548406912:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 81us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535965.592349:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 319 00000100:00100000:2.0:1788535965.597332:0:14733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548406656 00000100:00100000:2.0:1788535965.597349:0:14733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548406656 00000100:00100000:2.0:1788535965.597631:0:14733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:2.0:1788535965.597643:0:14733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2400:x1875415548406656:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535965.597726:0:14733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+8:2400:x1875415548406656:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 85us (15033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535965.597808:0:14733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00080000:3.0:1788535965.597928:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535965.597935:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535965.597940:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788535965.598772:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:1.0:1788535965.598785:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548406528:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535965.598842:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2400:x1875415548406528:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 60us (17569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535965.598849:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 158 00010000:00010000:1.0:1788535965.868332:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788535966.070042:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788535966.070052:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788535966.070074:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788535966.070082:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788535966.135229:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1788535966.135245:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1788535966.136809:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788535966.136840:0:6512:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9005c070e300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788535966.136845:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9005b7bb4400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9005c070e240 00000020:00080000:2.0:1788535966.136848:0:6512:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9005b7bb4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9004881e1800 00000020:00080000:2.0:1788535966.136877:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1788535966.136880:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535966.136893:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535966.136901:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535966.136907:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788535966.136915:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535966.136923:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788535966.136932:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:3.0:1788535966.136949:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff900487807b00) 00010000:00010000:3.0:1788535966.136953:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788535966.136958:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535966.136972:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838800/0xe79af2f39bbdd487 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788535966.136999:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000040:00080000:3.0:1788535966.765769:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788535966.892555:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535967.660950:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569422976:0@lo:400:kworker.0 00000100:00100000:3.0:1788535967.661017:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535967.661172:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569422976 00000100:00100000:1.0:1788535967.661180:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569422976 00000100:00100000:1.0:1788535967.661223:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788535967.661231:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569422976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.661797:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569423360:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.661851:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.661924:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569423360 00000100:00100000:0.0:1788535967.661930:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569423360 00000100:00100000:0.0:1788535967.661969:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788535967.661977:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569423360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.662016:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569423360:12345-0@lo:400:kworker.0 Request processed in 39us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535967.662022:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788535967.662061:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569423360:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663241:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788535967.663257:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569423872:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663310:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663342:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569423488:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663373:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663401:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569424384:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663430:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663447:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788535967.663452:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569424000:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663476:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663496:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569424512:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663516:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663555:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569423104:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663579:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663597:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569423616:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663616:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663633:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569424128:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663665:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663683:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788535967.663689:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569423232:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663710:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663727:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569423744:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663746:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663760:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569424256:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663779:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535967.663802:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569423872 00000100:00100000:0.0:1788535967.663818:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569423872 00000100:00100000:0.0:1788535967.663864:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569424384 00000100:00100000:0.0:1788535967.663867:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569424384 00000100:00100000:0.0:1788535967.663881:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569424000 00000100:00100000:0.0:1788535967.663884:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569424000 00000100:00100000:0.0:1788535967.663896:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569424512 00000100:00100000:0.0:1788535967.663898:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569424512 00000100:00100000:0.0:1788535967.663913:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788535967.663921:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569423872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.663964:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569423872:12345-0@lo:400:kworker.0 Request processed in 43us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535967.663971:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788535967.663986:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788535967.663992:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569424384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.664019:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569424384:12345-0@lo:400:kworker.0 Request processed in 28us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535967.664025:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788535967.664039:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788535967.664060:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569424000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.664262:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569424000:12345-0@lo:400:kworker.0 Request processed in 209us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535967.664269:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788535967.664282:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788535967.664288:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569424512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.664313:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569424512:12345-0@lo:400:kworker.0 Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535967.664319:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788535967.664337:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569423488 00000100:00100000:0.0:1788535967.664342:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569423488 00000100:00100000:0.0:1788535967.664359:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569423232 00000100:00100000:0.0:1788535967.664361:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569423232 00000100:00100000:0.0:1788535967.664372:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788535967.664377:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569423488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.664412:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569423488:12345-0@lo:400:kworker.0 Request processed in 34us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535967.664419:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788535967.664430:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569422976:12345-0@lo:400:kworker.0 Request processed in 3195us (3408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535967.664440:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788535967.664536:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788535967.664543:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569423232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535967.664731:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569422976:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.665001:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569423232:12345-0@lo:400:kworker.0 Request processed in 456us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535967.665004:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569423232:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.665016:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788535967.665049:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569423104 00000100:00100000:0.0:1788535967.665053:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569423104 00000100:00100000:2.0:1788535967.665368:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569424000:0@lo:400:kworker.0 00000100:00100000:2.0:1788535967.665387:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788535967.665392:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff900488922300, transno 4294967323 00000004:00080000:2.0:1788535967.665407:0:3660:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788535967.665424:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569424512:0@lo:400:kworker.0 00000100:00100000:2.0:1788535967.665436:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569424384:0@lo:400:kworker.0 00000100:00100000:2.0:1788535967.665446:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569423872:0@lo:400:kworker.0 00000100:00100000:2.0:1788535967.665455:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569423488:0@lo:400:kworker.0 00000100:00080000:2.0:1788535967.665484:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788535967.665488:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535967.665922:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569423616 00000100:00100000:0.0:1788535967.665929:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569423616 00000100:00100000:1.0:1788535967.665942:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569424128 00000100:00100000:1.0:1788535967.665949:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569424128 00000100:00100000:0.0:1788535967.665976:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569423744 00000100:00100000:1.0:1788535967.665981:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569424256 00000100:00100000:0.0:1788535967.665982:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569423744 00000100:00100000:1.0:1788535967.665988:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569424256 00000100:00100000:0.0:1788535967.666007:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788535967.666017:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569423104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535967.666023:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788535967.666034:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569423616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535967.666079:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569423616:12345-0@lo:400:kworker.0 Request processed in 48us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535967.666085:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788535967.666098:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788535967.666104:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569424128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535967.666126:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569424128:12345-0@lo:400:kworker.0 Request processed in 23us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535967.666132:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788535967.666142:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00080000:3.0:1788535967.666179:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535967.666182:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535967.666226:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569423744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535967.666253:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569423744:12345-0@lo:400:kworker.0 Request processed in 105us (2506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535967.666259:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788535967.666274:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569423104:12345-0@lo:400:kworker.0 Request processed in 257us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535967.666276:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788535967.666287:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569424256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.666288:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788535967.666319:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569424256:12345-0@lo:400:kworker.0 Request processed in 33us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535967.666325:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00080000:0.0:1788535967.666336:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb77800 x1875415569423744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535967.666349:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569423744:0@lo:400:kworker.0 00010000:00080000:0.0:1788535967.666362:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb75f80 x1875415569424256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535967.666369:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569424256:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.666379:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569423104:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.666392:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569423616:0@lo:400:kworker.0 00000100:00100000:0.0:1788535967.666402:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569424128:0@lo:400:kworker.0 00010000:00010000:1.0:1788535967.916528:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535968.181334:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535968.181355:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569424640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535968.181416:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535968.181473:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569424640 00000100:00100000:0.0:1788535968.181482:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569424640 00000100:00100000:0.0:1788535968.181612:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788535968.181622:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569424640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788535968.181651:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788535968.181706:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569424640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535968.181713:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788535968.181757:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569424640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788535968.186916:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788535968.186937:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569424768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788535968.186996:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535968.187184:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569424768 00000100:00100000:1.0:1788535968.187193:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569424768 00000100:00100000:1.0:1788535968.187239:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788535968.187249:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569424768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788535968.187268:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788535968.187325:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569424768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535968.187331:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788535968.187375:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569424768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788535968.311281:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535968.311386:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548407040 00000100:00100000:0.0:1788535968.311396:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548407040 00000100:00100000:0.0:1788535968.311467:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 255 00000100:00100000:0.0:1788535968.311478:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12183:x1875415548407040:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788535968.311596:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12183:x1875415548407040:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 120us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535968.311604:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 255 00000100:00080000:3.0:1788535968.311673:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788535968.315813:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535968.316009:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548407168 00000100:00100000:1.0:1788535968.316018:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548407168 00000100:00100000:1.0:1788535968.316098:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 256 00000100:00100000:1.0:1788535968.316108:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:12183:x1875415548407168:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788535968.316238:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+5:12183:x1875415548407168:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 131us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535968.316246:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 256 00000100:00080000:3.0:1788535968.316313:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535968.328646:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535968.328875:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548407424 00000100:00100000:0.0:1788535968.328884:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548407424 00000100:00100000:0.0:1788535968.328952:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1788535968.328962:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:12183:x1875415548407424:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788535968.329218:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:12183:x1875415548407424:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 257us (590us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788535968.329227:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1788535968.477959:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535968.478177:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548407552 00000100:00100000:2.0:1788535968.478187:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548407552 00000100:00100000:2.0:1788535968.478263:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 257 00000100:00100000:2.0:1788535968.478274:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:12988:x1875415548407552:12345-192.168.203.13@tcp:101:lsof.0 00010000:00010000:2.0:1788535968.478295:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788535968.478314:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655714 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535968.478380:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd51a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535968.478393:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd51a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535968.478404:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd51a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788535968.478465:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788535968.478468:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788535968.478487:0:6535:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd51a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535968.478510:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbdd513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655714 expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535968.478539:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd51a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655714 expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535968.478547:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464900) 00010000:00010000:2.0:1788535968.478550:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535968.478553:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067600, rc 0) 00000100:00100000:2.0:1788535968.478615:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:12988:x1875415548407552:12345-192.168.203.13@tcp:101:lsof.0 Request processed in 342us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535968.478622:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 257 00000100:00080000:3.0:1788535968.478798:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788535968.940623:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535969.196493:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569424896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535969.196572:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535969.196912:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569424896 00000100:00100000:3.0:1788535969.196921:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569424896 00000100:00100000:3.0:1788535969.196985:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788535969.196994:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569424896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788535969.197023:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535969.197080:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569424896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535969.197087:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788535969.197203:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535969.197378:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569424896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788535969.198743:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535969.198769:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569425024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788535969.198817:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535969.199049:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569425024 00000100:00100000:3.0:1788535969.199057:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569425024 00000100:00100000:3.0:1788535969.199111:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788535969.199118:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569425024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788535969.199165:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535969.199206:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569425024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535969.199213:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788535969.199265:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535969.199293:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569425024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788535969.709230:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788535969.709250:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569425152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788535969.709314:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535969.709378:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569425152 00000100:00100000:0.0:1788535969.709397:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569425152 00000100:00100000:0.0:1788535969.709440:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788535969.709449:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ba815850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569425152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788535969.709481:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788535969.709540:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ba815850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569425152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535969.709547:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788535969.709908:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569425152:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788535969.964347:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535970.221048:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569425280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535970.221118:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535970.221519:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569425280 00000100:00100000:1.0:1788535970.221529:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569425280 00000100:00100000:1.0:1788535970.221911:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788535970.221922:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569425280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788535970.221957:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788535970.222083:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569425280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535970.222091:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788535970.222280:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569425280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788535970.685804:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535970.685846:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535970.685879:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535970.685906:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535970.685919:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535970.685934:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535970.685957:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535970.685967:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548408192 00000100:00100000:2.0:1788535970.685978:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548408192 00000100:00100000:3.0:1788535970.685994:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548407936 00000100:00100000:3.0:1788535970.685999:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548407936 00000100:00100000:3.0:1788535970.686045:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548408448 00000100:00100000:2.0:1788535970.686045:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548408064 00000100:00100000:3.0:1788535970.686052:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548408448 00000100:00100000:2.0:1788535970.686052:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548408064 00000100:00100000:3.0:1788535970.686074:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548407808 00000100:00100000:3.0:1788535970.686077:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548407808 00000100:00100000:2.0:1788535970.686093:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:3.0:1788535970.686096:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548408320 00000100:00100000:3.0:1788535970.686100:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548408320 00000100:00100000:2.0:1788535970.686108:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548408192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535970.686120:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 326 00000100:00100000:3.0:1788535970.686129:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548407936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535970.686248:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:0.0:1788535970.686257:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548408064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535970.686293:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2402:x1875415548408192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 187us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535970.686302:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:1.0:1788535970.686326:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548407680 00000100:00080000:2.0:1788535970.686328:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535970.686332:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548407680 00000100:00080000:2.0:1788535970.686334:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788535970.686338:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788535970.686349:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788535970.686367:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 389 00000100:00100000:2.0:1788535970.686369:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 327 00000100:00100000:1.0:1788535970.686378:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548407680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788535970.686384:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548408448:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535970.686453:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548407936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 325us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535970.686461:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 326 00000100:00100000:3.0:1788535970.686475:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 328 00000100:00100000:3.0:1788535970.686482:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:2402:x1875415548407808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535970.686521:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:2402:x1875415548407808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535970.686645:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 328 00000100:00100000:3.0:1788535970.686666:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 329 00000100:00100000:3.0:1788535970.686675:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2402:x1875415548408320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788535970.686700:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2402:x1875415548408320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535970.686706:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 329 00000100:00100000:2.0:1788535970.693238:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2402:x1875415548408448:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 6848us (7318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535970.693253:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 327 00000100:00100000:0.0:1788535970.693337:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2402:x1875415548408064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 7078us (7398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535970.693349:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:1.0:1788535970.695266:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2402:x1875415548407680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 8880us (9461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535970.695398:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 389 00010000:00010000:2.0:1788535970.990730:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788535971.496967:0:15020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 11:32:50 (1788535970) 00010000:00010000:2.0:1788535972.013985:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788535972.271659:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1788535972.271676:0:6512:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788535972.271804:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788535972.271820:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788535972.781329:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569425536:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.781396:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535972.781438:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569426048:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.781459:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535972.781479:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569426560:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.781513:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535972.781535:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788535972.781541:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569425408:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.781567:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535972.781587:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569425920:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.781609:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535972.781723:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569425792:0@lo:400:kworker.0 00000100:00100000:3.0:1788535972.781795:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569425536 00000100:00100000:3.0:1788535972.781803:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569425536 00000100:00100000:3.0:1788535972.781845:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569426048 00000100:00100000:3.0:1788535972.781849:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569426048 00000100:00100000:3.0:1788535972.781875:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569426560 00000100:00100000:3.0:1788535972.781878:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569426560 00000100:00100000:3.0:1788535972.781898:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788535972.781909:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569425536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.781965:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569426432:0@lo:400:kworker.0 00000100:00100000:0.0:1788535972.782122:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569425664:0@lo:400:kworker.0 00000100:00100000:2.0:1788535972.783399:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535972.783428:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569426304:0@lo:400:kworker.0 00000100:00100000:2.0:1788535972.783454:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535972.783474:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569426816:0@lo:400:kworker.0 00000100:00100000:2.0:1788535972.783508:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535972.783558:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569426304 00000100:00100000:2.0:1788535972.783564:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569426304 00000100:00100000:2.0:1788535972.783607:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569426816 00000100:00100000:2.0:1788535972.783610:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569426816 00000100:00100000:2.0:1788535972.783639:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788535972.783647:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569426304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535972.783694:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569426304:12345-0@lo:400:kworker.0 Request processed in 48us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535972.783701:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788535972.783718:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788535972.783724:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569426816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535972.783749:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569426816:12345-0@lo:400:kworker.0 Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535972.783755:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788535972.783791:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569426304:0@lo:400:kworker.0 00000100:00100000:2.0:1788535972.783800:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569426816:0@lo:400:kworker.0 00000100:00100000:3.0:1788535972.784451:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569425536:12345-0@lo:400:kworker.0 Request processed in 2542us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535972.784461:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788535972.784479:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569425792 00000100:00100000:3.0:1788535972.784495:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569425792 00000100:00100000:3.0:1788535972.784516:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788535972.784523:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569426048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535972.784601:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569426048:12345-0@lo:400:kworker.0 Request processed in 77us (3139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535972.784608:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788535972.784630:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788535972.784638:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569426560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535972.784682:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569426560:12345-0@lo:400:kworker.0 Request processed in 45us (3168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535972.784688:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788535972.784700:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788535972.784706:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569425792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535972.784739:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569425792:12345-0@lo:400:kworker.0 Request processed in 33us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535972.784745:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788535972.784771:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569425920 00000100:00100000:3.0:1788535972.784775:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569425920 00000100:00100000:3.0:1788535972.784807:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788535972.784813:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569425920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535972.784863:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569425920:12345-0@lo:400:kworker.0 Request processed in 50us (3253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535972.784869:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:3.0:1788535972.784890:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788535972.784894:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788535972.784897:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535972.784954:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569425408 00000100:00100000:3.0:1788535972.784959:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569425408 00000100:00100000:3.0:1788535972.784987:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788535972.784993:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569425408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535972.785024:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89006101-b582-4041-a87b-c8866dc8e13c+24:3661:x1875415569425408:12345-0@lo:400:kworker.0 Request processed in 31us (3457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535972.785031:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788535972.786374:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535972.786419:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569426432 00000100:00100000:1.0:1788535972.786426:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569426432 00000100:00100000:1.0:1788535972.786471:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788535972.786479:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569426432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.786534:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569426432:12345-0@lo:400:kworker.0 Request processed in 56us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535972.786541:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1788535972.786568:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535972.786601:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569426432:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.786612:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569426944:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.786638:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535972.786659:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569426944 00000100:00100000:1.0:1788535972.786663:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569426944 00000100:00100000:1.0:1788535972.786692:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788535972.786697:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569426944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.786727:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569426944:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535972.786733:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1788535972.786746:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788535972.786762:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569426944:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.786775:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569425536:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.786786:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569426048:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.786796:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569426560:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.786825:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569425408:0@lo:400:kworker.0 00000100:00100000:1.0:1788535972.786837:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569425920:0@lo:400:kworker.0 00000100:00100000:2.0:1788535972.787731:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569425792:0@lo:400:kworker.0 00000100:00100000:0.0:1788535972.788092:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535972.788136:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569426176:0@lo:400:kworker.0 00000100:00100000:0.0:1788535972.788177:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535972.788199:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569426688:0@lo:400:kworker.0 00000100:00100000:0.0:1788535972.788219:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535972.788255:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569426176 00000100:00100000:0.0:1788535972.788261:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569426176 00000100:00100000:0.0:1788535972.788302:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569426688 00000100:00100000:0.0:1788535972.788306:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569426688 00000100:00100000:0.0:1788535972.788327:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788535972.788335:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569426176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535972.788386:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569426176:12345-0@lo:400:kworker.0 Request processed in 51us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535972.788393:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788535972.788408:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788535972.788415:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569426688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535972.789406:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569426688:12345-0@lo:400:kworker.0 Request processed in 988us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535972.789416:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:0.0:1788535972.789442:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788535972.789448:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569425664 00000100:00100000:2.0:1788535972.789454:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569425664 00010000:00080000:0.0:1788535972.789480:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fbc6680 x1875415569426176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535972.789500:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788535972.789531:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569425664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535972.789573:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569425664:12345-0@lo:400:kworker.0 Request processed in 54us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535972.789579:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788535972.791141:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569426176:0@lo:400:kworker.0 00010000:00080000:0.0:1788535972.791190:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7df80 x1875415569426688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535972.791200:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569426688:0@lo:400:kworker.0 00000100:00100000:0.0:1788535972.791234:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569425664:0@lo:400:kworker.0 00010000:00010000:2.0:1788535973.041880:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535973.292526:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535973.292549:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569427072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788535973.292612:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535973.292672:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569427072 00000100:00100000:3.0:1788535973.292680:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569427072 00000100:00100000:3.0:1788535973.292743:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788535973.292752:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569427072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788535973.292779:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788535973.292833:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569427072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535973.292840:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788535973.293255:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569427072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788535973.294543:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569427200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788535973.294596:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535973.294881:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569427200 00000100:00100000:3.0:1788535973.294889:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569427200 00000100:00100000:3.0:1788535973.294933:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788535973.294943:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569427200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788535973.296772:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788535973.296857:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569427200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1912us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535973.296866:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788535973.297022:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569427200:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788535974.061624:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535974.317401:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535974.317425:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569427328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788535974.317503:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535974.319691:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569427328 00000100:00100000:3.0:1788535974.319703:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569427328 00000100:00100000:3.0:1788535974.319762:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788535974.319773:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569427328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788535974.319801:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535974.319860:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569427328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (2357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535974.319867:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788535974.319922:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788535974.320163:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788535974.320176:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569427456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788535974.320213:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535974.320321:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569427456 00000100:00100000:1.0:1788535974.320327:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569427456 00000100:00100000:1.0:1788535974.320364:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788535974.320371:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569427456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788535974.320382:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788535974.320414:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569427456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535974.320431:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788535974.320468:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569427456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788535974.320701:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535974.321839:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569427328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788535974.519678:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535974.519879:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548408704 00000100:00100000:0.0:1788535974.519889:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548408704 00000100:00100000:0.0:1788535974.520243:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1788535974.520255:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+18:13211:x1875415548408704:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:0.0:1788535974.520523:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+19:13211:x1875415548408704:12345-192.168.203.13@tcp:35:umount.0 Request processed in 270us (853us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788535974.520532:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00080000:2.0:1788535974.520589:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788535974.529032:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535974.529534:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548408960 00000100:00100000:1.0:1788535974.529544:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548408960 00000100:00100000:1.0:1788535974.529604:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1788535974.529615:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+19:13211:x1875415548408960:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:1.0:1788535974.529901:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+20:13211:x1875415548408960:12345-192.168.203.13@tcp:35:umount.0 Request processed in 288us (879us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788535974.529909:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1788535974.538909:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535974.539181:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548409216 00000100:00100000:1.0:1788535974.539190:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548409216 00000100:00100000:1.0:1788535974.539248:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:1.0:1788535974.539259:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005baf10450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+20:13211:x1875415548409216:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:1.0:1788535974.539498:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005baf10450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9ef506c-5095-4495-a34a-e3b5845d008a+21:13211:x1875415548409216:12345-192.168.203.13@tcp:35:umount.0 Request processed in 240us (598us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788535974.539506:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1788535974.541966:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535974.542177:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548409472 00000100:00100000:0.0:1788535974.542187:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548409472 00000100:00100000:0.0:1788535974.542242:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:0.0:1788535974.542252:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+21:13211:x1875415548409472:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:0.0:1788535974.542536:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b9ef506c-5095-4495-a34a-e3b5845d008a+22:13211:x1875415548409472:12345-192.168.203.13@tcp:35:umount.0 Request processed in 284us (576us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788535974.542544:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1788535974.546736:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535974.546777:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535974.546852:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535974.546898:0:14733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548409984 00000100:00100000:3.0:1788535974.546907:0:14733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548409984 00000100:00100000:3.0:1788535974.547001:0:14733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1788535974.547017:0:14733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+7:2398:x1875415548409984:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:3.0:1788535974.547044:0:14733:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdca85 00000020:00010000:3.0:1788535974.547051:0:14733:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9004883a7800: total 0 00000100:00080000:3.0:1788535974.547056:0:14733:0:(import.c:65:import_set_state_nolock()) ffff9004883a1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788535974.547097:0:14733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788535974.547274:0:14733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2398:x1875415548409984:12345-192.168.203.13@tcp:9:umount.0 Request processed in 259us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535974.547283:0:14733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000020:00010000:3.0:1788535974.547308:0:6523:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9004883a7800: total 0 00010000:00010000:3.0:1788535974.547330:0:6523:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9004883a7800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788535974.547395:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdd50c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165570d expref: 4 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535974.547431:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c467a2d/0xe79af2f39bbdce3d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165552a expref: 3 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535974.547447:0:6523:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9004883a7800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788535974.547459:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535974.547461:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535974.547463:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788535974.548370:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788535974.552005:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535974.552390:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548409600 00000100:00100000:0.0:1788535974.552399:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548409600 00000100:00100000:0.0:1788535974.552456:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548410240 00000100:00100000:0.0:1788535974.552460:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548410240 00000100:00100000:0.0:1788535974.552496:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1788535974.552506:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+14:2400:x1875415548409600:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788535974.552524:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788535974.552698:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1788535974.552708:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91b20ee6-59cb-4913-858f-bc518949fc4a+14:2400:x1875415548410240:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535974.552717:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535974.552731:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461000/0xe79af2f39bbdc70c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655340 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535974.552747:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535974.552820:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91b20ee6-59cb-4913-858f-bc518949fc4a+13:2400:x1875415548410240:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 114us (5967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535974.552827:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00010000:00010000:0.0:1788535974.553128:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51e00/0xe79af2f39bbdc4f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655267 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535974.553139:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788535974.553222:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+11:2400:x1875415548409600:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 717us (6444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535974.553237:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1788535974.553658:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535974.554271:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548410368 00000100:00100000:0.0:1788535974.554280:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548410368 00000100:00100000:0.0:1788535974.554325:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:0.0:1788535974.554333:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2398:x1875415548410368:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:0.0:1788535974.554357:0:8448:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc80f 00000100:00080000:0.0:1788535974.554364:0:8448:0:(import.c:65:import_set_state_nolock()) ffff90059fca4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788535974.554424:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788535974.554617:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+2:2398:x1875415548410368:12345-192.168.203.13@tcp:9:umount.0 Request processed in 284us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535974.554624:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00010000:00010000:0.0:1788535974.554641:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788535974.555531:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788535974.555780:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548410112 00000100:00100000:1.0:1788535974.555788:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548410112 00000100:00100000:1.0:1788535974.555849:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1788535974.555858:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91b20ee6-59cb-4913-858f-bc518949fc4a+11:2400:x1875415548410112:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788535974.555870:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535974.555888:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e461a00/0xe79af2f39bbdc434 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655228 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535974.555904:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535974.555942:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2400:x1875415548410112:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 85us (3946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535974.555949:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788535974.578678:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535974.578786:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548411392 00000100:00100000:3.0:1788535974.578796:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548411392 00000100:00100000:3.0:1788535974.578881:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 258 00000100:00100000:3.0:1788535974.578890:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+22:2398:x1875415548411392:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:3.0:1788535974.578922:0:6535:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc442 00000020:00010000:3.0:1788535974.578939:0:6535:0:(genops.c:1921:obd_stale_export_put()) Put export ffff900487bd8000: total 0 00000100:00080000:3.0:1788535974.578956:0:6535:0:(import.c:65:import_set_state_nolock()) ffff900487bd9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788535974.578986:0:6535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1788535974.579135:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9ef506c-5095-4495-a34a-e3b5845d008a+21:2398:x1875415548411392:12345-192.168.203.13@tcp:39:umount.0 Request processed in 245us (466us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788535974.579143:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 258 00000020:00010000:2.0:1788535974.579499:0:9533:0:(genops.c:1907:obd_stale_export_get()) Get export ffff900487bd8000: total 0 00010000:00010000:2.0:1788535974.579560:0:9533:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff900487bd8000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788535974.579603:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535974.579606:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535974.579622:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838c00/0xe79af2f39bbdd3ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556c0 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579643:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:2.0:1788535974.579645:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788535974.579649:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e460600/0xe79af2f39bbdcae0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655443 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579664:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff900583670b00) 00010000:00010000:2.0:1788535974.579667:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535974.579671:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455000/0xe79af2f39bbdc76e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165534e expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579691:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:2.0:1788535974.579693:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788535974.579697:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838e00/0xe79af2f39bbdcec2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165554d expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579708:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535974.579711:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788535974.579715:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbdcd1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16554dd expref: 16 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579727:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff900487807f00) 00010000:00010000:2.0:1788535974.579729:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788535974.579732:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbdd1af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655626 expref: 15 pid: 10016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579747:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535974.579754:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535974.579759:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632e200/0xe79af2f39bbdd4cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16556f8 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579775:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff900487807500) 00010000:00010000:2.0:1788535974.579777:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788535974.579780:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066200/0xe79af2f39bbdd4f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655706 expref: 13 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579795:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff900486936b00) 00010000:00010000:2.0:1788535974.579797:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788535974.579800:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620fc00/0xe79af2f39bbdc7e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165536a expref: 12 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579814:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535974.579817:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788535974.579820:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059e455400/0xe79af2f39bbdce28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655523 expref: 11 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579830:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464900) 00010000:00010000:2.0:1788535974.579833:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788535974.579836:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbdcea6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655546 expref: 10 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579847:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900486936f00) 00010000:00010000:2.0:1788535974.579849:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788535974.579852:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbdc78a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655355 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579878:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90058feba400) 00010000:00010000:2.0:1788535974.579881:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788535974.579885:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067c00/0xe79af2f39bbdcdfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655515 expref: 8 pid: 10112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535974.579897:0:9533:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff900487bd8000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788535974.579911:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535974.579913:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535974.579915:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535974.585522:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535974.585673:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548411520 00000100:00100000:0.0:1788535974.585683:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548411520 00000100:00100000:0.0:1788535974.585764:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 259 00000100:00100000:0.0:1788535974.585773:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+5:2398:x1875415548411520:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:0.0:1788535974.585813:0:10016:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc449 00000100:00080000:0.0:1788535974.585831:0:10016:0:(import.c:65:import_set_state_nolock()) ffff900485d00800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788535974.585876:0:10016:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788535974.585907:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788535974.586100:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788535974.586519:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9ef506c-5095-4495-a34a-e3b5845d008a+3:2398:x1875415548411520:12345-192.168.203.13@tcp:39:umount.0 Request processed in 744us (1004us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788535974.586529:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 259 00000100:00100000:1.0:1788535974.828519:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569427584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788535974.828597:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535974.828732:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569427584 00000100:00100000:3.0:1788535974.828741:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569427584 00000100:00100000:2.0:1788535974.828928:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788535974.828939:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569427584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788535974.828981:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788535974.829036:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569427584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535974.829042:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788535974.829203:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569427584:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788535975.084382:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535975.341287:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535975.344419:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569427712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535975.344510:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535975.345261:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569427712 00000100:00100000:3.0:1788535975.345270:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569427712 00000100:00100000:3.0:1788535975.345369:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788535975.345379:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569427712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788535975.345415:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788535975.345494:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569427712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535975.345501:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788535975.345589:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569427712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535975.804846:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788535975.805004:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535975.805086:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548411776 00000100:00100000:0.0:1788535975.805107:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548411776 00000100:00100000:0.0:1788535975.805207:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 336 00000100:00100000:0.0:1788535975.805219:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2402:x1875415548411776:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788535975.805290:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2402:x1875415548411776:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535975.805297:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 336 00000100:00080000:2.0:1788535975.805369:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535975.806072:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548411648 00000100:00100000:1.0:1788535975.806079:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548411648 00000100:00100000:1.0:1788535975.806117:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 391 00000100:00100000:1.0:1788535975.806125:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548411648:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535975.806286:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2401:x1875415548411648:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 161us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535975.806294:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 391 00000100:00100000:2.0:1788535975.807509:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788535975.807600:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548411904 00000100:00100000:1.0:1788535975.807607:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548411904 00000100:00100000:1.0:1788535975.807671:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 337 00000100:00100000:1.0:1788535975.807680:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548411904:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788535975.807746:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2401:x1875415548411904:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535975.807753:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 337 00000100:00080000:2.0:1788535975.808014:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788535976.108364:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535976.184532:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535976.184576:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788535976.184609:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535976.184690:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548412160 00000100:00100000:3.0:1788535976.184700:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548412160 00000100:00100000:3.0:1788535976.184772:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548412032 00000100:00100000:3.0:1788535976.184777:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548412032 00000100:00100000:3.0:1788535976.184799:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548412288 00000100:00100000:3.0:1788535976.184802:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548412288 00000100:00100000:3.0:1788535976.184820:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1788535976.184829:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+12:2402:x1875415548412160:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535976.184843:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535976.184862:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e454000/0xe79af2f39bbdc705 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655339 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535976.184880:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535976.184926:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+11:2402:x1875415548412160:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 98us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535976.184948:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1788535976.184967:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1788535976.184974:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+10:2399:x1875415548412032:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535976.184983:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535976.184993:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50e00/0xe79af2f39bbdc545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165527c expref: 10 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535976.185002:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535976.185021:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+9:2399:x1875415548412032:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 48us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535976.185027:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1788535976.185070:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1788535976.185077:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+8:2399:x1875415548412288:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788535976.185085:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788535976.185093:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e454800/0xe79af2f39bbdc54c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16552ad expref: 8 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535976.185103:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788535976.185120:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:91b20ee6-59cb-4913-858f-bc518949fc4a+7:2399:x1875415548412288:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 44us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535976.185126:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1788535976.201288:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535976.201518:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548412544 00000100:00100000:3.0:1788535976.201538:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548412544 00000100:00100000:3.0:1788535976.201620:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 260 00000100:00100000:3.0:1788535976.201630:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+6:2398:x1875415548412544:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:3.0:1788535976.201685:0:10016:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc55a 00000020:00010000:3.0:1788535976.201695:0:10016:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9004878ef800: total 0 00000100:00080000:3.0:1788535976.201714:0:10016:0:(import.c:65:import_set_state_nolock()) ffff9004878ec800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788535976.201747:0:10016:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00010000:1.0:1788535976.201802:0:6523:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9004878ef800: total 0 00010000:00010000:1.0:1788535976.201808:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535976.201883:0:6523:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9004878ef800, canceled 0 locks, left on hash table 1. 00000100:00100000:3.0:1788535976.201918:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2398:x1875415548412544:12345-192.168.203.13@tcp:39:umount.0 Request processed in 288us (638us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1788535976.201928:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 260 00010000:00010000:1.0:1788535976.201936:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464900) 00010000:00010000:1.0:1788535976.201942:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788535976.201951:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067600/0xe79af2f39bbdd51a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655714 expref: 4 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535976.201976:0:6523:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9004878ef800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788535976.201991:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535976.201993:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535976.201995:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535976.219045:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535976.219676:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548412672 00000100:00100000:3.0:1788535976.219687:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548412672 00000100:00100000:3.0:1788535976.219812:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 261 00000100:00100000:3.0:1788535976.219823:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+5:2398:x1875415548412672:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:3.0:1788535976.219860:0:6535:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc561 00000100:00080000:3.0:1788535976.219871:0:6535:0:(import.c:65:import_set_state_nolock()) ffff9004878ed800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788535976.219903:0:6535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788535976.220072:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d9ac97c-7faa-47b0-a267-eea08d7bbce2+3:2398:x1875415548412672:12345-192.168.203.13@tcp:39:umount.0 Request processed in 250us (1035us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788535976.220081:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 261 00010000:00010000:0.0:1788535976.220137:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535976.262820:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788535976.262945:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548412928 00000100:00100000:3.0:1788535976.262955:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548412928 00000100:00100000:3.0:1788535976.263062:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 392 00000100:00100000:3.0:1788535976.263073:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+7:2398:x1875415548412928:12345-192.168.203.13@tcp:251:umount.0 00000020:00000080:3.0:1788535976.263129:0:6529:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc41f 00000020:00010000:3.0:1788535976.263137:0:6529:0:(genops.c:1921:obd_stale_export_put()) Put export ffff900487bdb800: total 0 00000100:00080000:3.0:1788535976.263142:0:6529:0:(import.c:65:import_set_state_nolock()) ffff900487bd9800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788535976.263262:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b20ee6-59cb-4913-858f-bc518949fc4a+3:2398:x1875415548412928:12345-192.168.203.13@tcp:251:umount.0 Request processed in 191us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535976.263287:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 392 00000020:00010000:2.0:1788535976.263436:0:9533:0:(genops.c:1907:obd_stale_export_get()) Get export ffff900487bdb800: total 0 00010000:00010000:2.0:1788535976.263500:0:9533:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff900487bdb800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788535976.263535:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e441e00/0xe79af2f39bbdc4f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165526e expref: 2 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535976.263551:0:9533:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff900487bdb800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788535976.263562:0:9533:0:(genops.c:885:class_export_put()) final put ffff900487bdb800/91b20ee6-59cb-4913-858f-bc518949fc4a 00010000:00010000:2.0:1788535976.263583:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535976.263586:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535976.263588:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788535976.264313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900487bdb800/91b20ee6-59cb-4913-858f-bc518949fc4a for MGS 00000020:00000080:0.0:1788535976.264367:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900487bd9800 for MGS 00000040:00080000:3.0:1788535976.302741:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788535976.302750:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788535976.302847:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788535976.302853:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788535977.006669:0:13814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788535977.132347:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535977.904049:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569427840:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904118:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.904200:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569428352:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904226:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.904246:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569428864:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904269:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.904301:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569429376:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904323:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.904349:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788535977.904366:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569428224:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904393:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.904415:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569428736:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904436:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.904465:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569429248:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904487:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.904519:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569427968:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904554:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.904573:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569428480:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904593:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.904612:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569428992:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.904635:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.905027:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788535977.905034:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569428096:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.905068:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.905087:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569428608:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.905108:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.905125:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569429120:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.905166:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.905196:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569427840 00000100:00100000:1.0:1788535977.905204:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569427840 00000100:00100000:1.0:1788535977.905253:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788535977.905270:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569427840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.905320:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059d43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89006101-b582-4041-a87b-c8866dc8e13c+24:3663:x1875415569427840:12345-0@lo:400:kworker.0 Request processed in 52us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535977.905328:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788535977.905440:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569428224 00000100:00100000:0.0:1788535977.905457:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569428224 00000100:00100000:1.0:1788535977.905462:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569427968 00000100:00100000:1.0:1788535977.905468:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569427968 00000100:00100000:0.0:1788535977.905487:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569428480 00000100:00100000:1.0:1788535977.905492:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569428992 00000100:00100000:0.0:1788535977.905493:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569428480 00000100:00100000:1.0:1788535977.905497:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569428992 00000100:00100000:3.0:1788535977.905632:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569428352 00000100:00100000:3.0:1788535977.905637:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569428352 00000100:00100000:3.0:1788535977.905662:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569428096 00000100:00100000:3.0:1788535977.905666:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569428096 00000100:00100000:1.0:1788535977.905669:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569428608 00000100:00100000:1.0:1788535977.905676:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569428608 00000100:00100000:3.0:1788535977.905687:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788535977.905696:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569428352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.905740:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569428352:12345-0@lo:400:kworker.0 Request processed in 46us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.905747:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788535977.905760:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788535977.905766:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569428096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.905800:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569428096:12345-0@lo:400:kworker.0 Request processed in 34us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.905806:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788535977.905824:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569428864 00000100:00100000:3.0:1788535977.905828:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569428864 00000100:00100000:3.0:1788535977.905851:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569429376 00000100:00100000:3.0:1788535977.905854:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569429376 00000100:00100000:3.0:1788535977.905865:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569428736 00000100:00100000:3.0:1788535977.905868:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569428736 00000100:00100000:3.0:1788535977.905878:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569429248 00000100:00100000:3.0:1788535977.905881:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569429248 00000100:00100000:3.0:1788535977.905894:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788535977.905907:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569428864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.905937:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569428864:12345-0@lo:400:kworker.0 Request processed in 32us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.905943:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788535977.905954:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788535977.905960:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569429376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.905985:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569429376:12345-0@lo:400:kworker.0 Request processed in 26us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.905991:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788535977.906000:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788535977.906006:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569428736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.906030:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569428736:12345-0@lo:400:kworker.0 Request processed in 25us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.906035:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788535977.906044:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788535977.906050:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569429248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.906074:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569429248:12345-0@lo:400:kworker.0 Request processed in 24us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.906079:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788535977.906098:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569429120 00000100:00100000:3.0:1788535977.906101:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569429120 00000100:00100000:3.0:1788535977.906120:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788535977.906125:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569428224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.906177:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569428224:12345-0@lo:400:kworker.0 Request processed in 51us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.906191:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788535977.906205:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788535977.906211:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569427968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.906243:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569427968:12345-0@lo:400:kworker.0 Request processed in 32us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535977.906255:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788535977.906266:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569428992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.906302:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875415569428992:12345-0@lo:400:kworker.0 Request processed in 39us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.906394:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788535977.906405:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788535977.906416:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788535977.906424:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569428608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.906427:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788535977.906439:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569429120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.906471:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569428608:12345-0@lo:400:kworker.0 Request processed in 48us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.906477:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788535977.906558:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569429120:12345-0@lo:400:kworker.0 Request processed in 54us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.906565:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569428224:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.906570:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788535977.906582:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569428736:0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.906596:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569429248:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.906610:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569428096:0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.906612:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569427840:0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.906631:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569428352:0@lo:400:kworker.0 00000100:00100000:3.0:1788535977.906642:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569428864:0@lo:400:kworker.0 00010000:00080000:1.0:1788535977.906649:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7ca80 x1875415569428608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535977.906653:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569429376:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.906668:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569428608:0@lo:400:kworker.0 00010000:00080000:1.0:1788535977.906694:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004883c7480 x1875415569429120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535977.906749:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788535977.906758:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569428480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535977.906795:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569428480:12345-0@lo:400:kworker.0 Request processed in 39us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535977.906800:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:0.0:1788535977.906818:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788535977.906822:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788535977.906825:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788535977.906827:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788535977.907364:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569429120:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.907382:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569427968:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.907395:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569428480:0@lo:400:kworker.0 00000100:00100000:1.0:1788535977.907409:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3660:1875415569428992:0@lo:400:kworker.0 00000020:01000004:0.0:1788535977.949044:0:15215:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788535977.973343:0:15215:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788535977.973398:0:15215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535977.973425:0:15215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535977.973432:0:15215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535977.973438:0:15215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535977.973472:0:15215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788535977.973478:0:15215:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788535977.973499:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1788535977.973507:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1788535977.973508:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788535977.973515:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788535977.973520:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455c00 already unused, calling callback (ffffffffc120ac20) 00000100:00080000:0.0:1788535977.973523:0:15215:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1788535977.973526:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.973538:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788535977.973553:0:15215:0:(import.c:65:import_set_state_nolock()) ffff9005842b4000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788535977.973646:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569429504:0@lo:39:umount.0 00000100:00100000:1.0:1788535977.973712:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1788535977.973877:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535977.973884:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788535977.973886:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788535977.973889:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788535977.973912:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.973928:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535977.973957:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.973965:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e455c00/0xe79af2f39bbdc4c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4ce expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.973977:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535977.973979:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535977.973981:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535977.974046:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569429504 00000100:00100000:3.0:1788535977.974054:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569429504 00000100:00100000:0.0:1788535977.974098:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569429632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535977.974132:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535977.974221:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788535977.974232:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875415569429504:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788535977.974262:0:6535:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc036 00000100:00080000:3.0:1788535977.974270:0:6535:0:(import.c:65:import_set_state_nolock()) ffff9005c06cf000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788535977.974327:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788535977.974347:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3659:x1875415569429504:12345-0@lo:39:umount.0 Request processed in 117us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535977.974354:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788535977.974365:0:6535:0:(genops.c:885:class_export_put()) final put ffff9005c06da000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1788535977.974756:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569429632 00000100:00100000:2.0:1788535977.974761:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569429632 00000100:00100000:2.0:1788535977.974800:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788535977.974807:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+24:3660:x1875415569429632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535977.974818:0:10351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535977.974834:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058db3f200/0xe79af2f39bbdc4ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc4c7 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.974847:0:10351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535977.974883:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89006101-b582-4041-a87b-c8866dc8e13c+23:3660:x1875415569429632:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535977.974890:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788535977.974994:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005842b4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788535977.975006:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569429504:0@lo:39:umount.0 00000100:00100000:1.0:1788535977.975049:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569429632:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788535977.975364:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788535977.975367:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788535977.975371:0:15215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788535977.976943:0:15215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.976961:0:15215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.976969:0:15215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.976976:0:15215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.977017:0:15215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788535977.977035:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535977.977040:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.977047:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460000 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535977.977051:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.977059:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535977.977077:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535977.977083:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788535977.977085:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788535977.977115:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.977121:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535977.977164:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.977171:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e460000/0xe79af2f39bbdc4d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4dc expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.977183:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535977.977184:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535977.977191:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535977.977209:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569429760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535977.977262:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535977.978765:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569429760 00000100:00100000:1.0:1788535977.978778:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569429760 00000100:00100000:1.0:1788535977.978881:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788535977.978890:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+23:3661:x1875415569429760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535977.978906:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788535977.978924:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdc4dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc4d5 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.978939:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788535977.979009:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89006101-b582-4041-a87b-c8866dc8e13c+22:3661:x1875415569429760:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535977.979016:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788535977.979095:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:3661:1875415569429760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535977.979272:0:15215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.979281:0:15215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.979288:0:15215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.979295:0:15215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.979343:0:15215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788535977.979351:0:15215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.979371:0:15215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.979377:0:15215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.979383:0:15215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979480:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788535977.979486:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979493:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e455600 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535977.979503:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979516:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535977.979523:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535977.979529:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788535977.979531:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788535977.979533:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788535977.979565:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979571:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535977.979601:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979609:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e455600/0xe79af2f39bbdc3d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc3e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979620:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535977.979623:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979629:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461400 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535977.979632:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979638:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535977.979650:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535977.979656:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788535977.979658:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788535977.979671:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979676:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788535977.979682:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979689:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535977.979691:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535977.979693:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535977.979706:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569430016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788535977.979745:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535977.979773:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788535977.979779:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569429888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788535977.979798:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535977.979823:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569430016 00000100:00100000:2.0:1788535977.979827:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569430016 00000100:00100000:2.0:1788535977.979857:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569429888 00000100:00100000:2.0:1788535977.979860:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569429888 00000100:00100000:2.0:1788535977.979879:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788535977.979885:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+23:3663:x1875415569430016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535977.979895:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535977.979905:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900580030600/0xe79af2f39bbdc744 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc73d expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979920:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535977.979948:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+22:3663:x1875415569430016:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535977.979954:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788535977.979968:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788535977.979974:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+21:3663:x1875415569429888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535977.979982:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535977.979990:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e455800/0xe79af2f39bbdc3e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc3d9 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.979998:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788535977.980018:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+20:3663:x1875415569429888:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535977.980023:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788535977.980048:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569429888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788535977.980056:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:89006101-b582-4041-a87b-c8866dc8e13c:3663:1875415569430016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788535977.980533:0:15215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788535977.980539:0:15215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e461400/0xe79af2f39bbdc73d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc744 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535977.980557:0:15215:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788535977.980564:0:15215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.980571:0:15215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.980578:0:15215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535977.980584:0:15215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.980656:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535977.980661:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.980668:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3f000 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535977.980671:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.980678:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535977.980695:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535977.980701:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788535977.980703:0:9533:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1788535977.980721:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.980726:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788535977.980770:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569430144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788535977.980806:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788535977.980846:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.980854:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535977.980855:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535977.980857:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788535977.980867:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569430144 00000100:00100000:2.0:1788535977.980872:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569430144 00000100:00100000:2.0:1788535977.980900:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788535977.980906:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+20:3660:x1875415569430144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788535977.980914:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788535977.980923:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdbf9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdbf95 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535977.980933:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788535977.980984:0:15215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788535977.980989:0:15215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3f000/0xe79af2f39bbdbf95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdbf9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535977.981010:0:15215:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1788535977.981013:0:15215:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788535977.981016:0:15215:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788535977.981081:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788535977.981094:0:15215:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788535977.981098:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788535977.981103:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788535977.981108:0:15215:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:1.0:1788535977.981113:0:15215:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff900487543000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788535977.981118:0:15215:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff900485ffa000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788535977.981123:0:15215:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9005b799b800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788535977.981127:0:15215:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9005b799f000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788535977.981135:0:15215:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9004878ef800 8d9ac97c-7faa-47b0-a267-eea08d7bbce2 192.168.203.13@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788535977.981139:0:15215:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff900487bd8000 b9ef506c-5095-4495-a34a-e3b5845d008a 192.168.203.13@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:1.0:1788535977.981161:0:15215:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9005acbecd40) has exports, disconnecting them 00000020:00080000:1.0:1788535977.981166:0:15215:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff900487543000), last request at 1788535977 00000020:00000080:1.0:1788535977.981172:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc346 00000100:00080000:1.0:1788535977.981188:0:15215:0:(import.c:65:import_set_state_nolock()) ffff900487545000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788535977.981231:0:15215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff900487543000): rc 0 00000020:00000080:1.0:1788535977.981234:0:15215:0:(genops.c:885:class_export_put()) final put ffff900487543000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:2.0:1788535977.981366:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89006101-b582-4041-a87b-c8866dc8e13c+19:3660:x1875415569430144:12345-0@lo:103:ldlm_bl.0 Request processed in 458us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788535977.981373:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788535977.981404:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788535977.982687:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9005c06da000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788535977.982750:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005c06cf000 for lustre-MDT0000 00000020:00080000:1.0:1788535977.983504:0:15215:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff900485ffa000), last request at 1788535977 00000020:00000080:1.0:1788535977.983514:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc227 00000100:00080000:1.0:1788535977.983525:0:15215:0:(import.c:65:import_set_state_nolock()) ffff900485ffb800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788535977.983625:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900487543000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788535977.983677:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900487545000 for lustre-MDT0000 00010000:00010000:2.0:1788535977.983688:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788535977.983719:0:15215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff900485ffa000): rc 0 00000020:00000080:1.0:1788535977.983722:0:15215:0:(genops.c:885:class_export_put()) final put ffff900485ffa000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788535977.983745:0:15215:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9005b799b800), last request at 1788535760 00000020:00000080:1.0:1788535977.983749:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc11d 00000100:00080000:1.0:1788535977.983754:0:15215:0:(import.c:65:import_set_state_nolock()) ffff9005b7999000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788535977.983771:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788535977.983780:0:15215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9005b799b800): rc 0 00000020:00000080:1.0:1788535977.983782:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005b799b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788535977.983787:0:15215:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9005b799f000), last request at 1788535759 00000020:00000080:1.0:1788535977.983790:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc0e5 00000100:00080000:1.0:1788535977.983793:0:15215:0:(import.c:65:import_set_state_nolock()) ffff90059e395800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788535977.983801:0:15215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:1.0:1788535977.983881:0:15215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9005b799f000): rc 0 00000004:00000080:1.0:1788535977.983888:0:15215:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa58c414a3ae0 00000100:00080000:1.0:1788535977.983907:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788535977.983910:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1788535977.984172:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788535977.984178:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff900485ffa000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788535977.984207:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9005b799b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788535977.984229:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900485ffb800 for lustre-MDT0000 00000020:00000080:2.0:1788535977.984232:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005b7999000 for lustre-MDT0000 00000100:00080000:1.0:1788535977.986008:0:15215:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788535977.986039:0:15215:0:(import.c:65:import_set_state_nolock()) ffff9005893a7800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788535977.986225:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569430272:0@lo:39:umount.0 00000100:00100000:0.0:1788535977.986294:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535977.988626:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569430144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535977.988775:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569430272 00000100:00100000:1.0:1788535977.988784:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569430272 00000100:00100000:1.0:1788535977.988840:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788535977.988849:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875415569430272:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788535977.988878:0:6538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc18d 00000100:00080000:1.0:1788535977.988887:0:6538:0:(import.c:65:import_set_state_nolock()) ffff9005842eb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788535977.988920:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788535977.989081:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3659:x1875415569430272:12345-0@lo:39:umount.0 Request processed in 221us (2775us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788535977.989089:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1788535977.991648:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788535977.991656:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00010000:00010000:0.0:1788535977.992064:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788535977.992117:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005893a7800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788535977.992128:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569430272:0@lo:39:umount.0 00000004:00080000:1.0:1788535977.992898:0:15215:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788535977.992959:0:15215:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788535977.992986:0:15215:0:(import.c:65:import_set_state_nolock()) ffff90059fa9e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788535977.993003:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788535977.993006:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788535977.993023:0:15215:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788535977.993089:0:15215:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788535977.993097:0:15215:0:(import.c:65:import_set_state_nolock()) ffff9004878e8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788535977.993125:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9005acbecd40) has no exports 00000100:00100000:0.0:1788535977.995192:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569430400:0@lo:9:umount.0 00000100:00100000:0.0:1788535977.995274:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535977.995304:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569430528:0@lo:9:umount.0 00000100:00100000:0.0:1788535977.995325:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535977.995360:0:14733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569430400 00000100:00100000:0.0:1788535977.995367:0:14733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569430400 00000100:00100000:0.0:1788535977.995404:0:14733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569430528 00000100:00100000:0.0:1788535977.995407:0:14733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569430528 00000100:00100000:0.0:1788535977.995427:0:14733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788535977.995435:0:14733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1875415569430400:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788535977.995471:0:14733:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc2d6 00000100:00080000:0.0:1788535977.995482:0:14733:0:(import.c:65:import_set_state_nolock()) ffff900486959000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788535977.995521:0:14733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788535977.995638:0:14733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3659:x1875415569430400:12345-0@lo:9:umount.0 Request processed in 202us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535977.995646:0:14733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788535977.995660:0:14733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788535977.995668:0:14733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1875415569430528:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788535977.995679:0:14733:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc40a 00000100:00080000:0.0:1788535977.995685:0:14733:0:(import.c:65:import_set_state_nolock()) ffff900487bdb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788535977.995709:0:14733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788535977.995784:0:14733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3659:x1875415569430528:12345-0@lo:9:umount.0 Request processed in 117us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535977.995791:0:14733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1788535977.995813:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788535977.995841:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059fa9e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1788535977.996039:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788535978.001691:0:3659:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788535978.001708:0:3659:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788535978.001718:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569430400:0@lo:9:umount.0 00000100:00080000:0.0:1788535978.001777:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9004878e8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788535978.001794:0:3659:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788535978.001795:0:3659:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788535978.001798:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569430528:0@lo:9:umount.0 00000020:00080000:3.0:1788535978.006709:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9005acbecd40) has no exports 00000020:00000080:3.0:1788535978.056066:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbff0 00000020:00000080:3.0:1788535978.056080:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005c06d8800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788535978.056099:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788535978.056192:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005c06d8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788535978.057327:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535978.057349:0:15215:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788535978.057355:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90059d493380) has no exports 00000020:00000080:0.0:1788535978.059722:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbfe9 00000020:00000080:0.0:1788535978.059735:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005c06c8800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788535978.063406:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005c06c8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788535978.070626:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535978.070641:0:15215:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788535978.070647:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005c06cb000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788535978.070651:0:15215:0:(genops.c:844:class_export_destroy()) destroying export ffff9005c06cb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788535978.070669:0:15215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1788535978.156884:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535978.412745:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788535978.412770:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569430656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788535978.412838:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535978.413242:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569430656 00000100:00100000:3.0:1788535978.413250:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569430656 00000100:00100000:3.0:1788535978.413306:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788535978.413316:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569430656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788535978.413345:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788535978.413405:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569430656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535978.413413:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788535978.413516:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569430656:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788535979.181171:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535979.441416:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569430784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788535979.441553:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535979.446577:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569430784 00000100:00100000:3.0:1788535979.446593:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569430784 00000100:00100000:3.0:1788535979.446674:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788535979.446684:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569430784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788535979.446714:0:12164:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788535979.446819:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569430784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (5266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535979.446827:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788535979.447074:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788535979.448449:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569430784:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788535979.950249:0:7464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788535979.950273:0:7464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788535979.950279:0:7464:0:(genops.c:885:class_export_put()) final put ffff9005b780b800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788535979.950296:0:7464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000001:00080000:3.0:1788535979.950301:0:7464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788535979.950303:0:7464:0:(genops.c:885:class_export_put()) final put ffff9004878ec000/8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000001:00100000:3.0:1788535979.950309:0:7464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000001:00080000:3.0:1788535979.950313:0:7464:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788535979.950315:0:7464:0:(genops.c:885:class_export_put()) final put ffff900485d03800/b9ef506c-5095-4495-a34a-e3b5845d008a 00000001:00100000:0.0:1788535979.959277:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788535979.959286:0:8441:0:(genops.c:885:class_export_put()) final put ffff90048695c800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788535979.959300:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:0.0:1788535979.959302:0:8441:0:(genops.c:885:class_export_put()) final put ffff90059fca2800/b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:1.0:1788535979.959431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005b780b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788535979.959501:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9004878ec000/8d9ac97c-7faa-47b0-a267-eea08d7bbce2 for lustre-MDT0001 00000020:00000080:1.0:1788535979.959533:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900485d03800/b9ef506c-5095-4495-a34a-e3b5845d008a for lustre-MDT0001 00000020:00000080:1.0:1788535979.959555:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90048695c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788535979.959570:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059fca2800/b9ef506c-5095-4495-a34a-e3b5845d008a for lustre-OST0000 00000020:00000080:1.0:1788535979.959602:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005842eb000 for lustre-MDT0001 00000020:00000080:1.0:1788535979.959607:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9004878ed800 for lustre-MDT0001 00000020:00000080:1.0:1788535979.959611:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900485d00800 for lustre-MDT0001 00000020:00000080:1.0:1788535979.959614:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900486959000 for lustre-OST0000 00000020:00000080:1.0:1788535979.959643:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90059fca4000 for lustre-OST0000 00000001:00100000:3.0:1788535979.961553:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788535979.961562:0:6512:0:(genops.c:885:class_export_put()) final put ffff9005b799f000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788535979.961600:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000001:00080000:3.0:1788535979.961607:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:3.0:1788535979.961611:0:6512:0:(genops.c:885:class_export_put()) final put ffff9004878ef800/8d9ac97c-7faa-47b0-a267-eea08d7bbce2 00000001:00100000:3.0:1788535979.961616:0:6512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000001:00080000:3.0:1788535979.961620:0:6512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788535979.961627:0:6512:0:(genops.c:885:class_export_put()) final put ffff900487bd8000/b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:1.0:1788535979.961767:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005b799f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788535979.961819:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9004878ef800/8d9ac97c-7faa-47b0-a267-eea08d7bbce2 for lustre-MDT0000 00000020:00000080:1.0:1788535979.961988:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900487bd8000/b9ef506c-5095-4495-a34a-e3b5845d008a for lustre-MDT0000 00000020:00000080:1.0:1788535979.962018:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90059e395800 for lustre-MDT0000 00000020:00000080:1.0:1788535979.962024:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9004878ec800 for lustre-MDT0000 00000020:00000080:1.0:1788535979.962027:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900487bd9000 for lustre-MDT0000 00000001:00100000:3.0:1788535979.967631:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788535979.967642:0:9525:0:(genops.c:885:class_export_put()) final put ffff900487bdd000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788535979.967674:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:3.0:1788535979.967677:0:9525:0:(genops.c:885:class_export_put()) final put ffff9004883a7800/b9ef506c-5095-4495-a34a-e3b5845d008a 00000020:00000080:0.0:1788535979.968341:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff900487bdd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788535979.968403:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9004883a7800/b9ef506c-5095-4495-a34a-e3b5845d008a for lustre-OST0001 00000020:00000080:0.0:1788535979.968423:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900487bdb000 for lustre-OST0001 00000020:00000080:0.0:1788535979.968429:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9004883a1800 for lustre-OST0001 00000020:01000000:2.0:1788535980.076725:0:15215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff900486bf0840 - data ffff9005bb7471b0/ffff90059e4ea800 00000020:01000000:2.0:1788535980.076903:0:15215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9005c07cf8a0 - data ffff9005bb4241b0/ffff90059e07d800 00000001:00000004:2.0:1788535980.086119:0:15215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:3.0:1788535980.145242:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788535980.145251:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788535980.145268:0:15215:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9004883c5c00 x1875415569430272/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788535987 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535980.145307:0:15215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788535980.148180:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788535980.148188:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788535980.148216:0:15215:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788535980.148219:0:15215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788535980.148797:0:8503:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788535980.148803:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788535980.148813:0:8503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788535980.150217:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788535980.150224:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788535980.150249:0:15215:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788535980.150252:0:15215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788535980.150910:0:10022:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788535980.150914:0:10022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788535980.150923:0:10022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788535980.152637:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbfb8 00000020:00000080:3.0:1788535980.152647:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005842ed000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788535980.153034:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005842ed000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788535980.161638:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbfcd 00000020:00000080:3.0:1788535980.161652:0:15215:0:(genops.c:885:class_export_put()) final put ffff90059b609000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788535980.161662:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788535980.161667:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788535980.161768:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059b609000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788535980.161819:0:15215:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788535980.161824:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9005acbe99c0) has no exports 00000004:01000000:3.0:1788535980.162018:0:15215:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788535980.162027:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc403 00000020:00000080:3.0:1788535980.162031:0:15215:0:(genops.c:885:class_export_put()) final put ffff9004878eb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788535980.162045:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788535980.162049:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788535980.162058:0:15215:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788535980.162061:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9005b7a7b380) has no exports 00000020:00000080:3.0:1788535980.162067:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc3fc 00000020:00000080:3.0:1788535980.162071:0:15215:0:(genops.c:885:class_export_put()) final put ffff9004878e8800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788535980.162471:0:15215:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788535980.162475:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788535980.162480:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788535980.162486:0:15215:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788535980.162488:0:15215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788535980.162615:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9004878eb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788535980.162622:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9004878e8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788535980.162626:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9004878e8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788535980.163012:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788535980.163023:0:15215:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788535980.163026:0:15215:0:(genops.c:885:class_export_put()) final put ffff9004878eb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788535980.163029:0:15215:0:(genops.c:844:class_export_destroy()) destroying export ffff9004878eb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788535980.163033:0:15215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788535980.163102:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc2c1 00000020:00000080:3.0:1788535980.163106:0:15215:0:(genops.c:885:class_export_put()) final put ffff90059fa9c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788535980.163122:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788535980.163126:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788535980.163131:0:15215:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788535980.163134:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff90059fa94d40) has no exports 00000020:00000080:3.0:1788535980.163139:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc2ba 00000020:00000080:3.0:1788535980.163142:0:15215:0:(genops.c:885:class_export_put()) final put ffff90059fa98800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788535980.163959:0:15215:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788535980.163963:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788535980.163967:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788535980.163971:0:15215:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788535980.163973:0:15215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788535980.164660:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059fa9c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788535980.164679:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059fa98800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788535980.164849:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788535980.164860:0:15215:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788535980.164873:0:15215:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788535980.164879:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc186 00000020:00000080:3.0:1788535980.164885:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005893a7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788535980.164890:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788535980.164895:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788535980.164900:0:15215:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788535980.164902:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9005baf28000) has no exports 00000020:00000080:3.0:1788535980.164909:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc17f 00000020:00000080:3.0:1788535980.164912:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005893a1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788535980.165223:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90059fa9e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788535980.165231:0:37:0:(genops.c:885:class_export_put()) final put ffff900486808800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788535980.165233:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900486808800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788535980.165237:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788535980.165319:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005893a7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788535980.165323:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005893a1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788535980.168251:0:15215:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788535980.168259:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788535980.168273:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788535980.168281:0:15215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788535980.168334:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535980.168345:0:15215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788535980.168371:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535980.168373:0:15215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788535980.168378:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005842e9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788535980.168381:0:15215:0:(genops.c:844:class_export_destroy()) destroying export ffff9005842e9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788535980.168389:0:15215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788535980.168500:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbfd4 00000020:00000080:0.0:1788535980.168507:0:15215:0:(genops.c:885:class_export_put()) final put ffff90059b60b000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788535980.168512:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788535980.168524:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535980.168529:0:15215:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788535980.168533:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9005acbe8000) has no exports 00000020:00000080:0.0:1788535980.168550:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535980.168554:0:15215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788535980.168558:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbfdb 00000020:00000080:0.0:1788535980.168562:0:15215:0:(genops.c:885:class_export_put()) final put ffff90059b60d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788535980.168570:0:15215:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9005831fb800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788535980.168573:0:15215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9005831fb800 3 00000020:01000004:0.0:1788535980.168576:0:15215:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9005831fb800 from lustre-MDT0000 00000020:00000080:0.0:1788535980.168594:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535980.168597:0:15215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788535980.168600:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005842ed800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788535980.168602:0:15215:0:(genops.c:844:class_export_destroy()) destroying export ffff9005842ed800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788535980.168608:0:15215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788535980.168636:0:15215:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788535980.168639:0:15215:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788535980.168642:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788535980.168644:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535980.168646:0:15215:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788535980.168657:0:15215:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9005aca92800 89006101-b582-4041-a87b-c8866dc8e13c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788535980.168662:0:15215:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9005acbeb380) has exports, disconnecting them 00000020:00080000:0.0:1788535980.168666:0:15215:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9005aca92800), last request at 1788535740 00000020:00000080:0.0:1788535980.169070:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbf79 00000020:00010000:0.0:1788535980.169076:0:15215:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9005aca92800: total 2 00000100:00080000:0.0:1788535980.169080:0:15215:0:(import.c:65:import_set_state_nolock()) ffff9005aca95800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788535980.169101:0:15215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9005aca92800): rc 0 00000020:00080000:0.0:1788535980.169105:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9005acbeb380) has no exports 00000100:00100000:0.0:1788535980.169207:0:6526:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9005acaa2a00:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1788535980.169304:0:6529:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9005894ea600:6529] 2 exiting: rc = 0 00000020:00010000:0.0:1788535980.169353:0:6522:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9005aca92800: total 2 00010000:00010000:0.0:1788535980.169381:0:6522:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9005aca92800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788535980.169417:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50000/0xe79af2f39bbdc4ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc4e3 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.169440:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e440e00/0xe79af2f39bbdc47a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc473 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.169453:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900580031a00/0xe79af2f39bbdc728 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc721 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.169465:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e460200/0xe79af2f39bbdc736 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc72f expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.169475:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af51800/0xe79af2f39bbdc39a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc393 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.169489:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e454400/0xe79af2f39bbdc496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc48f expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.169499:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e440800/0xe79af2f39bbdc488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc481 expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788535980.169635:0:6528:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9005acaa3c00:6528] 1 exiting: rc = 0 00000020:00000080:1.0:1788535980.169703:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005893a7800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788535980.169709:0:37:0:(genops.c:885:class_export_put()) final put ffff9005b7809000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788535980.169711:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005b7809000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788535980.169716:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788535980.169766:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059b60b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788535980.169776:0:37:0:(genops.c:885:class_export_put()) final put ffff9005842e9000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788535980.169778:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005842e9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788535980.169781:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788535980.169808:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059b60d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788535980.170050:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e441600/0xe79af2f39bbdc4a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc49d expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.170062:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e440a00/0xe79af2f39bbdc4b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc4ab expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.170072:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059620ea00/0xe79af2f39bbdc71a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc713 expref: 5 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.170082:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059e441200/0xe79af2f39bbdc4c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc4b9 expref: 4 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.170091:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632f800/0xe79af2f39bbdc075 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc06e expref: 3 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.170102:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632f200/0xe79af2f39bbdc083 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe79af2f39bbdc07c expref: 2 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535980.170111:0:6522:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9005aca92800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788535980.170126:0:6522:0:(genops.c:885:class_export_put()) final put ffff9005aca92800/89006101-b582-4041-a87b-c8866dc8e13c 00010000:00010000:0.0:1788535980.170142:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535980.170163:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535980.170165:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535980.170193:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170201:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170207:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170212:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170218:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170223:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170229:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170243:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170249:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170255:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170259:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170265:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170270:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170276:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170281:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170287:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788535980.170367:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005aca92800/89006101-b582-4041-a87b-c8866dc8e13c for MGS 00000020:00000080:1.0:1788535980.170392:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005aca95800 for MGS 00000100:00100000:0.0:1788535980.170491:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170500:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170506:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170511:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170584:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170594:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170600:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170606:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170611:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170616:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170622:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170627:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170632:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170637:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170643:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170648:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170653:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170658:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170663:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170668:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170743:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170751:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170756:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170761:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170766:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170771:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170785:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170790:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170795:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170800:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170804:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170809:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170814:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170819:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170823:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170828:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170833:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170907:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170914:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170920:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170925:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170929:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170934:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170939:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170944:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170950:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170955:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535980.170961:0:15215:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788535980.173851:0:15215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff900486bf0180 - data ffff9005bb754d80/ffff90059e551400 00000020:01000000:0.0:1788535980.173968:0:15215:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90059d537d80 - data ffff9005bb47a360/ffff9005baf90c00 00000020:00000080:0.0:1788535980.174803:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbf5d 00000020:00000080:0.0:1788535980.174812:0:15215:0:(genops.c:885:class_export_put()) final put ffff90058ad62800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788535980.174833:0:15215:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9005831fb800 from MGS, refs=2 00000020:01000004:0.0:1788535980.174894:0:15215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9005831fb800 2 00000020:01000004:0.0:1788535980.174897:0:15215:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9005831fb800 from MGS 00000020:00000080:0.0:1788535980.174921:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535980.174928:0:15215:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788535980.174931:0:15215:0:(genops.c:885:class_export_put()) final put ffff90058ad63000/MGS 00000020:00000080:0.0:1788535980.174934:0:15215:0:(genops.c:844:class_export_destroy()) destroying export ffff90058ad63000/MGS for MGS 00000020:01000000:0.0:1788535980.174941:0:15215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788535980.175015:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788535980.175019:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535980.175025:0:15215:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788535980.175033:0:15215:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9005842b6000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788535980.175038:0:15215:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9005c06fcd40) has exports, disconnecting them 00000020:00080000:0.0:1788535980.175043:0:15215:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9005842b6000), last request at 1788535741 00000020:00000080:0.0:1788535980.175047:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc028 00000020:00080000:0.0:1788535980.175059:0:15215:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9005842b6000): rc 0 00000020:00000080:0.0:1788535980.175063:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005842b6000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788535980.175647:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90058ad62800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788535980.175662:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9005842b6000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788535980.176970:0:15215:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788535980.176976:0:15215:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788535980.176980:0:15215:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788535980.176986:0:15215:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788535980.177007:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005842b4000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788535980.177135:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535980.177142:0:15215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788535980.177158:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005842b7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788535980.177161:0:15215:0:(genops.c:844:class_export_destroy()) destroying export ffff9005842b7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788535980.177166:0:15215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788535980.177229:0:15215:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9005831fb800 1 00000020:00000080:1.0:1788535980.177234:0:15215:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbf4f 00000020:00000080:1.0:1788535980.177239:0:15215:0:(genops.c:885:class_export_put()) final put ffff90058ad66000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788535980.177246:0:15215:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788535980.177252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90058ad66000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788535980.177260:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788535980.177263:0:15215:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788535980.177266:0:15215:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90059d494d40) has no exports 00010000:00010000:1.0:1788535980.206477:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788535980.258405:0:15215:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535980.258418:0:15215:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788535980.258444:0:15215:0:(genops.c:885:class_export_put()) final put ffff9005831f8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788535980.258449:0:15215:0:(genops.c:844:class_export_destroy()) destroying export ffff9005831f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788535980.258455:0:15215:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788535980.258563:0:15215:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9005831fe000 00000020:02000400:1.0:1788535980.258662:0:15215:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788535980.460776:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569430912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788535980.460836:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535980.461001:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569430912 00000100:00100000:0.0:1788535980.461008:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569430912 00000100:00100000:0.0:1788535980.461049:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788535980.461056:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3663:x1875415569430912:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788535980.461063:0:6538:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788535980.461100:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3663:x1875415569430912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (263us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788535980.461106:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:02020000:2.0:1788535980.461186:0:3663:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788535980.469372:0:3663:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788535980.469380:0:3663:0:(import.c:65:import_set_state_nolock()) ffff90059e0ec800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788535980.469384:0:3663:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788535980.476754:0:3663:0:(import.c:65:import_set_state_nolock()) ffff90059e0ec800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788535980.476769:0:3663:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 218 00000100:00080000:2.0:1788535980.476779:0:3663:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90059e0ec800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788535980.476969:0:3663:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900481cfca80 x1875415569431040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788535980.477210:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569431040:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788535980.477281:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535980.477412:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569431040 00000100:00100000:3.0:1788535980.477419:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569431040 00000100:00100000:3.0:1788535980.477493:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788535980.477514:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569431040:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788535980.477535:0:6538:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788535980.477597:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569431040:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 83us (315us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788535980.477610:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1788535980.477644:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059e0ec800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788535980.477650:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788535980.477653:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569431040:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788535981.232368:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535982.254499:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788535983.021452:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788535983.021477:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788535983.021481:0:36:0:(import.c:65:import_set_state_nolock()) ffff90059e0ec800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788535983.021489:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 439 00000100:00080000:2.0:1788535983.021494:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788535983.021502:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90059e0ec800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788535983.021535:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fbc7100 x1875415569431296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788535983.021622:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569431296:0@lo:38:kworker.0 00000100:00100000:3.0:1788535983.021632:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569431424:0@lo:400:kworker.0 00000100:00100000:1.0:1788535983.021702:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569431168:0@lo:400:kworker.0 00000100:00100000:3.0:1788535983.021763:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535983.021808:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569431936:0@lo:400:kworker.0 00000100:00100000:3.0:1788535983.021831:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535983.021871:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569431424 00000100:00100000:3.0:1788535983.021877:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569431424 00000100:00100000:3.0:1788535983.021908:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569431936 00000100:00100000:3.0:1788535983.021911:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569431936 00000100:00100000:3.0:1788535983.021927:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788535983.021934:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875415569431424:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788535983.021941:0:10016:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788535983.021973:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535983.021977:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875415569431424:12345-0@lo:400:kworker.0 Request processed in 43us (214us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788535983.021984:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788535983.021998:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788535983.022001:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875415569431936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788535983.022002:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569431552:0@lo:400:kworker.0 00000020:00080000:3.0:1788535983.022006:0:10016:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788535983.022025:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535983.022026:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875415569431936:12345-0@lo:400:kworker.0 Request processed in 24us (196us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788535983.022031:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788535983.022040:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569431552 00000100:00100000:2.0:1788535983.022040:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569432064:0@lo:400:kworker.0 00000100:00100000:3.0:1788535983.022042:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569431552 00000100:00100000:2.0:1788535983.022060:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535983.022061:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788535983.022065:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1875415569431552:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788535983.022069:0:10016:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788535983.022071:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788535983.022075:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569431680:0@lo:400:kworker.0 00000100:00100000:3.0:1788535983.022091:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1875415569431552:12345-0@lo:400:kworker.0 Request processed in 25us (66us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788535983.022092:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535983.022096:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788535983.022101:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569432192:0@lo:400:kworker.0 00000100:00100000:3.0:1788535983.022104:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569432064 00000100:00100000:3.0:1788535983.022106:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569432064 00000100:00100000:2.0:1788535983.022121:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535983.022132:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569431680 00000100:00100000:3.0:1788535983.022142:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569431680 00000100:00100000:3.0:1788535983.022177:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00080000:2.0:1788535983.022178:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788535983.022183:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569432064:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788535983.022183:0:3662:0:(import.c:65:import_set_state_nolock()) ffff90048680f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788535983.022186:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788535983.022215:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875415569432064:12345-0@lo:400:kworker.0 Request processed in 33us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535983.022221:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788535983.022232:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788535983.022237:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569431680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788535983.022261:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569431680:12345-0@lo:400:kworker.0 Request processed in 24us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535983.022266:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:3.0:1788535983.022288:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788535983.023471:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788535983.023534:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9005b799d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788535983.023539:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788535983.023544:0:3661:0:(import.c:65:import_set_state_nolock()) ffff9005b799d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788535983.023548:0:3661:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 218 00000100:00080000:3.0:1788535983.023554:0:3661:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9005b799d800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788535983.023584:0:3661:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900488870700 x1875415569432320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788535983.023606:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569431424:0@lo:400:kworker.0 00000100:00080000:3.0:1788535983.023626:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788535983.023629:0:3661:0:(import.c:65:import_set_state_nolock()) ffff90059fa9a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788535983.023632:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788535983.023634:0:3661:0:(import.c:65:import_set_state_nolock()) ffff90059fa9a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788535983.023637:0:3661:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 258 00000100:00080000:3.0:1788535983.023641:0:3661:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90059fa9a000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788535983.023653:0:3661:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900488873b80 x1875415569432448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788535983.023661:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569431936:0@lo:400:kworker.0 00000100:00100000:3.0:1788535983.024243:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569431296 00000100:00100000:3.0:1788535983.024250:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569431296 00000100:00100000:3.0:1788535983.024285:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788535983.024291:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569431296:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788535983.024430:0:6538:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788535983.024599:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569431296:12345-0@lo:38:kworker.0 Request processed in 306us (2625us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788535983.024606:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000400:00000100:1.0:1788535983.024869:0:3660:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875415569431168 offset 0 length 224: 4 00000100:00100000:1.0:1788535983.024902:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569431808:0@lo:400:kworker.0 00000100:00100000:1.0:1788535983.024933:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535983.026131:0:14733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569432192 00000100:00100000:0.0:1788535983.026140:0:14733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569432192 00000100:00100000:1.0:1788535983.026219:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569431808 00000100:00100000:1.0:1788535983.026224:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569431808 00000100:00100000:1.0:1788535983.026277:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788535983.026286:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569431808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788535983.026352:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569431808:12345-0@lo:400:kworker.0 Request processed in 67us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535983.026360:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788535983.026403:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569431808:0@lo:400:kworker.0 00000100:00080000:3.0:1788535983.026626:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788535983.026784:0:14733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788535983.026792:0:14733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569432192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788535983.026845:0:14733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569432192:12345-0@lo:400:kworker.0 Request processed in 54us (4722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788535983.026851:0:14733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788535983.026938:0:6530:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788535983.033034:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875415569432320:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788535983.033118:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535983.033209:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3659:1875415569432448:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788535983.033233:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788535983.033276:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059e0ec800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788535983.033281:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788535983.033284:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569431296:0@lo:38:kworker.0 00000100:00100000:0.0:1788535983.033395:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569432320 00000100:00100000:0.0:1788535983.033402:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569432320 00000100:00100000:0.0:1788535983.033454:0:10016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569432448 00000100:00100000:0.0:1788535983.033458:0:10016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569432448 00000100:00100000:0.0:1788535983.033497:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788535983.033504:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1875415569432320:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788535983.033526:0:10016:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788535983.033565:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1875415569432320:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 60us (447us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788535983.033572:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788535983.033589:0:10016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788535983.033593:0:10016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1875415569432448:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788535983.033602:0:10016:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788535983.033624:0:10016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1875415569432448:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 29us (390us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788535983.033630:0:10016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1788535983.033830:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005b799d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788535983.033835:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788535983.033838:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875415569432320:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788535983.033846:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059fa9a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788535983.033849:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788535983.033852:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3659:1875415569432448:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1788535983.040091:0:3662:0:(import.c:65:import_set_state_nolock()) ffff90048680f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788535983.040105:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 237 00000100:00080000:2.0:1788535983.040114:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90048680f000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788535983.041097:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb7b100 x1875415569432576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788535983.041215:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569431552:0@lo:400:kworker.0 00010000:00080000:2.0:1788535983.041250:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9004888df800 x1875415569432064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535983.041260:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3662:1875415569432064:0@lo:400:kworker.0 00010000:00080000:2.0:1788535983.041287:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9004888df100 x1875415569431680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788535999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788535983.041294:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569431680:0@lo:400:kworker.0 00000100:00100000:2.0:1788535983.041306:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569432192:0@lo:400:kworker.0 00000100:00100000:1.0:1788535983.041461:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3659:1875415569432576:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788535983.041543:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788535983.041711:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569432576 00000100:00100000:2.0:1788535983.041719:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569432576 00000100:00100000:2.0:1788535983.041757:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788535983.041763:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1875415569432576:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788535983.041783:0:6535:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788535983.041830:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1875415569432576:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 66us (287us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788535983.041837:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788535983.041960:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90048680f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788535983.041965:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788535983.041968:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3659:1875415569432576:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1788535983.282343:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788535983.309642:0:15416:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788535983.325122:0:15416:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788535983.325203:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.325217:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.325226:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.325234:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.325272:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788535983.325277:0:15416:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788535983.325302:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788535983.325307:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788535983.325312:0:15416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788535983.325318:0:15416:0:(import.c:65:import_set_state_nolock()) ffff9005b799d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788535983.325323:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788535983.325324:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788535983.325328:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788535983.325961:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535983.325969:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535983.325977:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e600 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535983.325981:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535983.326000:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535983.326007:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535983.326013:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788535983.326016:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788535983.326019:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788535983.326056:0:6523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535983.326062:0:6523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788535983.326086:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535983.326092:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3e600/0xe79af2f39bbdc4ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4b2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535983.326106:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535983.326108:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535983.326110:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535983.326130:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569432704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535983.326221:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788535983.326284:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569432704 00000100:00100000:1.0:1788535983.326291:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569432704 00000100:00100000:1.0:1788535983.326327:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788535983.326334:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3660:x1875415569432704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788535983.326339:0:10351:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788535983 with bad export cookie 16688918497278672761 00010000:00010000:3.0:1788535983.328141:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328192:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328200:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328207:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328254:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788535983.328261:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328268:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328290:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328296:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328308:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788535983.328313:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328319:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328326:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328332:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328342:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788535983.328348:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328355:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328362:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328379:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788535983.328389:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788535983.328392:0:15416:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788535983.328440:0:15416:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788535983.328445:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788535983.328449:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788535983.328455:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788535983.328461:0:15416:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff900486809000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788535983.328466:0:15416:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90048695e000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788535983.328495:0:15416:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9005c06fb380) has exports, disconnecting them 00000020:00080000:3.0:1788535983.328500:0:15416:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff900486809000), last request at 1788535983 00000020:00000080:3.0:1788535983.328507:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc35b 00000100:00080000:3.0:1788535983.328539:0:15416:0:(import.c:65:import_set_state_nolock()) ffff90048680b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788535983.328594:0:15416:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff900486809000): rc 0 00000020:00000080:3.0:1788535983.328636:0:15416:0:(genops.c:885:class_export_put()) final put ffff900486809000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788535983.328649:0:15416:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90048695e000), last request at 1788535983 00000020:00000080:3.0:1788535983.328652:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc235 00000100:00080000:3.0:1788535983.328657:0:15416:0:(import.c:65:import_set_state_nolock()) ffff90048695d800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788535983.328678:0:15416:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90048695e000): rc 0 00000020:00000080:3.0:1788535983.328681:0:15416:0:(genops.c:885:class_export_put()) final put ffff90048695e000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788535983.328687:0:15416:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa58c414a3ae0 00000100:00080000:3.0:1788535983.328717:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788535983.328740:0:15416:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff900481cfc000 x1875415569430912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788535996 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788535983.328768:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1788535983.330442:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569430912:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788535983.330477:0:15416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788535983.330483:0:15416:0:(import.c:65:import_set_state_nolock()) ffff90059e0ec800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788535983.330503:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788535983.330513:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330523:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460400 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535983.330527:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330618:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788535983.330619:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788535983.330626:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 10000000:00010000:0.0:1788535983.330628:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535983.330635:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788535983.330638:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00000004:00080000:3.0:1788535983.330639:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:01000000:0.0:1788535983.330641:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1788535983.330676:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330683:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535983.330708:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788535983.330710:0:15416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:0.0:1788535983.330717:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e460400/0xe79af2f39bbdc4b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc4c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788535983.330726:0:15416:0:(import.c:65:import_set_state_nolock()) ffff9005b7b08000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788535983.330729:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788535983.330734:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788535983.330740:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00010000:00010000:0.0:1788535983.330742:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461600 already unused, calling callback (ffffffffc120ac20) 00000100:00100000:3.0:1788535983.330744:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 10000000:00010000:0.0:1788535983.330747:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788535983.330753:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1788535983.330755:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535983.330773:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788535983.330779:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788535983.330781:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788535983.330784:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788535983.330809:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330816:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788535983.330821:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569432960:0@lo:9:umount.0 00010000:00010000:0.0:1788535983.330835:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330843:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e461600/0xe79af2f39bbdc393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc39a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330856:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788535983.330860:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330865:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460e00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535983.330868:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330875:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788535983.330882:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535983.330886:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788535983.330903:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788535983.330906:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788535983.330908:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788535983.330925:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330931:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535983.330939:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535983.330943:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569432960 00010000:00010000:0.0:1788535983.330947:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e460e00/0xe79af2f39bbdc72f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc736 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535983.330952:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569432960 00010000:00010000:0.0:1788535983.330960:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788535983.330965:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330983:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580031800 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788535983.330988:0:6522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.330995:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535983.330998:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 10000000:00010000:0.0:1788535983.331006:0:6522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788535983.331013:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875415569432960:12345-0@lo:9:umount.0 10000000:01000000:0.0:1788535983.331015:0:6522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788535983.331022:0:6522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788535983.331024:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:3.0:1788535983.331040:0:8446:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc282 00000100:00080000:3.0:1788535983.331050:0:8446:0:(import.c:65:import_set_state_nolock()) ffff90048695a000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788535983.331059:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.331066:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788535983.331074:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535983.331081:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff900580031800/0xe79af2f39bbdc07c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe79af2f39bbdc083 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788535983.331083:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1788535983.331105:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535983.331109:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788535983.331112:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535983.331128:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569433088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535983.331194:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788535983.331232:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788535983.331238:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569433216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535983.331259:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788535983.331272:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3659:x1875415569432960:12345-0@lo:9:umount.0 Request processed in 262us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788535983.331282:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788535983.331292:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569433088 00000100:00100000:0.0:1788535983.331297:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569433088 00000100:00100000:0.0:1788535983.331318:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569433216 00000100:00100000:0.0:1788535983.331321:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569433216 00000100:00080000:3.0:1788535983.331322:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005b7b08000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788535983.331333:0:3659:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:0.0:1788535983.331334:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000004:00080000:3.0:1788535983.331336:0:3659:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788535983.331343:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569432960:0@lo:9:umount.0 00000100:00100000:0.0:1788535983.331344:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3662:x1875415569433088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788535983.331354:0:6519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788535983 with bad export cookie 16688918497278672761 00000100:00080000:3.0:1788535983.331369:0:15416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788535983.331388:0:15416:0:(import.c:65:import_set_state_nolock()) ffff900487bda000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788535983.331394:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3662:x1875415569433088:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (199us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788535983.331402:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788535983.331426:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569433472:0@lo:9:umount.0 00000100:00100000:0.0:1788535983.331439:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788535983.331445:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3662:x1875415569433216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788535983.331458:0:6519:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788535983 with bad export cookie 16688918497278672761 00000100:00100000:0.0:1788535983.331489:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3662:x1875415569433216:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (228us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788535983.331495:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788535983.331525:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788535983.331528:0:3662:0:(import.c:65:import_set_state_nolock()) ffff9005aca94800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788535983.331542:0:3662:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788535983.332108:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788535983.332197:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9005c06fb380) has no exports 00000100:00100000:1.0:1788535983.337261:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3660:x1875415569432704:12345-0@lo:103:ldlm_bl.0 Request processed in 10921us (11035us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788535983.337275:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788535983.338636:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788535983.338649:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff900486809000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788535983.338693:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90048695e000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788535983.338713:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90048680b000 for lustre-MDT0001 00000020:00000080:2.0:1788535983.338717:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90048695d800 for lustre-MDT0001 00010000:00010000:2.0:1788535983.345686:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788535983.348705:0:3662:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.113@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788535983.348710:0:3662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788535983.348720:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90059fbc6d80 x1875415569431168/t0(0) o400->MGC192.168.203.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788535999 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535983.348735:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90048891d500 x1875415569432704/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788535999 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535983.348745:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff900481cfed80 x1875415569433088/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788535999 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535983.348754:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff900481cff800 x1875415569433216/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788535999 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788535983.348768:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788535983.348770:0:3662:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788535983.348772:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788535983.348776:0:3662:0:(import.c:65:import_set_state_nolock()) ffff9005aca94800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788535983.348780:0:3662:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 199 00000100:00080000:0.0:1788535983.348789:0:3662:0:(import.c:665:import_select_connection()) MGC192.168.203.113@tcp: import ffff9005aca94800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788535983.348803:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:0:1875415569433344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535983.348833:0:10017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569433472 00000100:00100000:1.0:1788535983.348841:0:10017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569433472 00000100:00100000:3.0:1788535983.348860:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:89006101-b582-4041-a87b-c8866dc8e13c:0:1875415569432832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535983.348905:0:10017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788535983.348916:0:10017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875415569433472:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788535983.349076:0:10017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc3c4 00000100:00080000:1.0:1788535983.349086:0:10017:0:(import.c:65:import_set_state_nolock()) ffff90059fa9b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788535983.349142:0:10017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788535983.349323:0:10017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3659:x1875415569433472:12345-0@lo:9:umount.0 Request processed in 409us (17867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788535983.349331:0:10017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788535983.349451:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900487bda000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788535983.349464:0:3659:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788535983.349467:0:3659:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788535983.349472:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569433472:0@lo:9:umount.0 00000100:00100000:1.0:1788535983.349507:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569432704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535983.349516:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:89006101-b582-4041-a87b-c8866dc8e13c:3660:1875415569431168:0@lo:400:kworker.0 00000100:00100000:0.0:1788535983.349592:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900481cfdf80 x1875415569433600/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788535983.349616:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788535983.349626:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569433088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788535983.349646:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:89006101-b582-4041-a87b-c8866dc8e13c:3662:1875415569433216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788535983.349822:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89006101-b582-4041-a87b-c8866dc8e13c:3659:1875415569433600:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788535983.349851:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875415569433600 offset 0 length 520: 4 00000020:00080000:3.0:1788535983.358124:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9005c06fb380) has no exports 00000020:01000000:2.0:1788535983.383215:0:15416:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff900485d7dcc0 - data ffff90048603c948/ffff9004875cdc00 00000020:01000000:2.0:1788535983.383376:0:15416:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9005ac8677e0 - data ffff9005bb560870/ffff9005bb021400 00000001:00000004:3.0:1788535983.404423:0:15416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788535983.435495:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788535983.435503:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788535983.435510:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788535983.437198:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788535983.437203:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788535983.437218:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788535983.437220:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788535983.437454:0:8496:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788535983.437459:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788535983.437468:0:8496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788535983.437974:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788535983.437977:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788535983.437992:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788535983.437994:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788535983.438256:0:10013:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788535983.438260:0:10013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788535983.438267:0:10013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788535983.438982:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc09f 00000020:00000080:2.0:1788535983.438991:0:15416:0:(genops.c:885:class_export_put()) final put ffff9005bb33e800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788535983.439531:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005bb33e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788535983.440783:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc0b4 00000020:00000080:2.0:1788535983.440792:0:15416:0:(genops.c:885:class_export_put()) final put ffff90059e394000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788535983.440843:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788535983.440849:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535983.440856:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788535983.440861:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9005c06f8000) has no exports 00000004:01000000:2.0:1788535983.441053:0:15416:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788535983.441061:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc3bd 00000020:00000080:2.0:1788535983.441065:0:15416:0:(genops.c:885:class_export_put()) final put ffff900485ffe000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788535983.441181:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059e394000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788535983.441311:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788535983.441316:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535983.441323:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788535983.441326:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff90059fa93380) has no exports 00000020:00000080:2.0:1788535983.441332:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc3b6 00000020:00000080:2.0:1788535983.441336:0:15416:0:(genops.c:885:class_export_put()) final put ffff900487bde800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788535983.441708:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900485ffe000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788535983.441716:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900487bde800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788535983.442111:0:15416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788535983.442115:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788535983.442129:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788535983.442134:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788535983.442137:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788535983.442233:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788535983.442242:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788535983.442249:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc27b 00000020:00000080:2.0:1788535983.442253:0:15416:0:(genops.c:885:class_export_put()) final put ffff900485ff8800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788535983.442257:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788535983.442261:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535983.442264:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788535983.442267:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff90059e1b19c0) has no exports 00000020:00000080:2.0:1788535983.442271:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc274 00000020:00000080:2.0:1788535983.442274:0:15416:0:(genops.c:885:class_export_put()) final put ffff900485ffe800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788535983.442605:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff900487bda000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788535983.442612:0:37:0:(genops.c:885:class_export_put()) final put ffff90048680d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788535983.442614:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90048680d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788535983.442619:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788535983.442689:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900485ff8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788535983.442694:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900485ffe800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788535983.443066:0:15416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788535983.443070:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788535983.443073:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788535983.443077:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788535983.443079:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788535983.443111:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788535983.443117:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788535983.443134:0:15416:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788535983.443141:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc0d7 00000020:00000080:0.0:1788535983.443209:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005b7b08000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788535983.443215:0:37:0:(genops.c:885:class_export_put()) final put ffff900485ffc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788535983.443217:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900485ffc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788535983.443221:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788535983.443321:0:15416:0:(genops.c:885:class_export_put()) final put ffff9005b799b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788535983.443608:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788535983.443613:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535983.443618:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788535983.443621:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90059d4919c0) has no exports 00000020:00000080:2.0:1788535983.443626:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc0d0 00000020:00000080:2.0:1788535983.443630:0:15416:0:(genops.c:885:class_export_put()) final put ffff90059e0e9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788535983.443721:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005b799b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788535983.444771:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059e0e9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788535983.449272:0:15416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788535983.449281:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788535983.449285:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788535983.449293:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788535983.449344:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535983.449355:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788535983.449380:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535983.449384:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788535983.449398:0:15416:0:(genops.c:885:class_export_put()) final put ffff9005bb339000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788535983.449402:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9005bb339000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788535983.449422:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788535983.449458:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90059e0ec800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788535983.449472:0:37:0:(genops.c:885:class_export_put()) final put ffff90059e0ea000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788535983.449474:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059e0ea000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788535983.449478:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788535983.449649:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc0bb 00000020:00000080:0.0:1788535983.449655:0:15416:0:(genops.c:885:class_export_put()) final put ffff90059e392800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788535983.449665:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788535983.449669:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535983.449674:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788535983.449678:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9005c06f99c0) has no exports 00000020:00000080:0.0:1788535983.449695:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535983.449698:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788535983.449702:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc0c2 00000020:00000080:0.0:1788535983.449706:0:15416:0:(genops.c:885:class_export_put()) final put ffff90059e397800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788535983.449714:0:15416:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9005831a8000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788535983.449717:0:15416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9005831a8000 2 00000020:01000004:0.0:1788535983.449720:0:15416:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9005831a8000 from lustre-MDT0001 00000020:00000080:0.0:1788535983.449736:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788535983.449739:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788535983.449741:0:15416:0:(genops.c:885:class_export_put()) final put ffff9005bb338800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788535983.449744:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9005bb338800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788535983.449749:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788535983.449776:0:15416:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788535983.449780:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788535983.449782:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788535983.449785:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788535983.449792:0:15416:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9005b799d000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788535983.449798:0:15416:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9005b7a799c0) has exports, disconnecting them 00000020:00080000:0.0:1788535983.449802:0:15416:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9005b799d000), last request at 1788535760 00000020:00000080:0.0:1788535983.449805:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc116 00000020:00080000:0.0:1788535983.449816:0:15416:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9005b799d000): rc 0 00000020:00000080:0.0:1788535983.449825:0:15416:0:(genops.c:885:class_export_put()) final put ffff9005b799d000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788535983.450404:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059e392800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788535983.450421:0:37:0:(genops.c:885:class_export_put()) final put ffff9005b9e16800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788535983.450423:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005b9e16800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788535983.450427:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788535983.450598:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059e397800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788535983.450602:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005b799d000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788535983.450623:0:15416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788535983.450627:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788535983.450630:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788535983.450634:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788535983.450650:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005b799d800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788535983.450831:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535983.450836:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788535983.450839:0:15416:0:(genops.c:885:class_export_put()) final put ffff9005b799c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788535983.450842:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9005b799c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788535983.450850:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788535983.450877:0:15416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9005831a8000 1 00000020:00000080:1.0:1788535983.450880:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc052 00000020:00000080:1.0:1788535983.450883:0:15416:0:(genops.c:885:class_export_put()) final put ffff9005bb33c000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788535983.450890:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788535983.451378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005bb33c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788535983.451391:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788535983.451395:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788535983.451398:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9005baf2cd40) has no exports 00000020:00000080:2.0:1788535983.499033:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788535983.499047:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788535983.499052:0:15416:0:(genops.c:885:class_export_put()) final put ffff9005831aa000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788535983.499065:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9005831aa000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788535983.499075:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788535983.499333:0:15416:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9005831ae800 00000020:01000000:2.0:1788535983.499351:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788535983.499355:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535983.499359:0:15416:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788535983.499362:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90059d490000) has no exports 00000100:00100000:0.0:1788535983.499652:0:6534:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9005aca8d000:6534] 1 exiting: rc = 0 00000100:00100000:2.0:1788535983.499783:0:6535:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9005aca9da00:6535] 2 exiting: rc = 0 00000100:00100000:0.0:1788535983.499878:0:10016:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff900485fc0a00:10016] 3 exiting: rc = 0 00000100:00100000:1.0:1788535983.499967:0:6533:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9005aca8c400:6533] 0 exiting: rc = 1 00000100:00100000:3.0:1788535983.500066:0:10112:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff900487a84800:10112] 4 exiting: rc = 0 00000100:00100000:2.0:1788535983.500343:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500351:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500356:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500362:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500368:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500373:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500378:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500383:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500388:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500393:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500399:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500405:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500418:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500424:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500431:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500437:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500443:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500448:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500454:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500459:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500464:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500469:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500475:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500480:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500486:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500491:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500507:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500513:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500517:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500586:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500594:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500600:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500605:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500611:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500617:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500622:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500627:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500633:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500638:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500643:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500649:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500653:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500658:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500663:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500668:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500672:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500677:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500683:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500689:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500694:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500699:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500704:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500709:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500714:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500719:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500724:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500929:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500939:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500945:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500950:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500955:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500970:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500975:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.500982:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.504293:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9005831a5e00:6536] 0 exiting: rc = 1 00000100:00100000:0.0:1788535983.504641:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9005831a4600:6537] 1 exiting: rc = 0 00000100:00100000:2.0:1788535983.504731:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504739:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504745:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504751:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504757:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504764:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504770:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504775:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504780:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504785:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504791:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504797:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504803:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504809:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504814:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504819:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504823:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504828:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504833:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504838:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504842:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504847:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504852:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504856:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504861:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504866:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504871:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504875:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504880:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504885:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504890:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504894:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504910:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504915:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504920:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504925:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504930:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504935:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504941:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504945:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504950:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504954:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504959:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504964:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504968:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504972:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504978:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504983:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504987:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504992:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.504996:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505001:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505005:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505010:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505014:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505018:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505023:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505027:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505031:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505036:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505040:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505045:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505050:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.505059:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.506867:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90058a17b800:6538] 0 exiting: rc = 1 00000100:00100000:0.0:1788535983.507100:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff900590864c00:6539] 1 exiting: rc = 0 00000100:00100000:3.0:1788535983.507466:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507475:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507482:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507488:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507494:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507500:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507505:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507530:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507538:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507544:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507550:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507556:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507562:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507568:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507574:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507579:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507584:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507590:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507597:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507617:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507634:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507639:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507645:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507651:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507657:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507663:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507670:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507676:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507681:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507687:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507693:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507714:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507721:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507727:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507733:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507739:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507744:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507750:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507755:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507760:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507766:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507772:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507778:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507799:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507806:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507811:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507817:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507823:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507830:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507836:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507843:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507849:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507854:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507859:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507865:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507891:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507899:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507905:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507910:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507916:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507922:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507928:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507934:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.507947:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.514406:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff900590865400:6540] 0 exiting: rc = 1 00000100:00100000:0.0:1788535983.514783:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90058a17b400:6541] 1 exiting: rc = 0 00000100:00100000:2.0:1788535983.514877:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514884:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514890:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514905:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514910:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514915:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514919:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514924:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514928:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514933:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514939:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514944:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514949:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514954:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514959:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514965:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514970:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514976:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514981:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514987:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514992:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.514997:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515002:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515007:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515011:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515016:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515022:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515027:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515031:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515036:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515041:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515046:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515051:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515056:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515061:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515066:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515072:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515076:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515089:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515094:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515099:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515103:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515109:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515114:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515119:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515124:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515129:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515134:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515140:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515172:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515178:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515183:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515188:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515193:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515198:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515204:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515209:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515213:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515217:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515221:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515227:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515232:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515238:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515243:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788535983.515578:0:6543:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff900590865200:6543] 1 exiting: rc = 0 00000100:00100000:0.0:1788535983.515763:0:6542:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff900590864200:6542] 0 exiting: rc = 1 00000100:00100000:2.0:1788535983.515841:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515847:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515853:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515858:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515864:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515870:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515875:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515880:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515886:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515897:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515902:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515908:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515913:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515918:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515923:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515927:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515932:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515937:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515943:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515948:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515954:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515959:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515964:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515970:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515975:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515980:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515986:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515991:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.515996:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516001:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516007:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516012:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516018:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516022:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516028:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516033:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516038:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516044:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516049:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516054:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516059:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516064:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516070:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516075:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516087:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516093:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516098:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516103:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516108:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516113:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516119:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516123:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516128:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516133:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516138:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516143:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516263:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516269:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516274:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516279:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516284:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516289:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516294:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.516300:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788535983.517097:0:6544:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff900590865e00:6544] 0 exiting: rc = 1 00000100:00100000:3.0:1788535983.517422:0:6545:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff900584d6d800:6545] 1 exiting: rc = 0 00000100:00100000:2.0:1788535983.517638:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517646:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517651:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517657:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517663:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517668:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517674:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517679:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517685:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517689:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517694:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517699:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517703:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517708:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517713:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517728:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517733:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517738:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517743:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517748:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517753:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517758:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517763:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517768:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517773:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517779:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517784:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517788:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517794:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517799:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517804:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517810:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517815:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517820:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517826:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517831:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517837:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517842:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517848:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517853:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517858:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517864:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517869:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517874:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517879:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517884:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517890:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517895:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517900:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517904:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517916:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517921:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517926:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517931:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517936:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517941:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517946:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517951:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517956:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517961:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517965:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517971:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517976:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.517982:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788535983.519021:0:6547:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9005831a4000:6547] 1 exiting: rc = 0 00000100:00100000:1.0:1788535983.519270:0:6548:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9005876af400:6548] 2 exiting: rc = 0 00000100:00100000:3.0:1788535983.519617:0:6546:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff900584d6de00:6546] 0 exiting: rc = 1 00000100:00100000:2.0:1788535983.519704:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519723:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519730:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519736:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519741:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519746:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519752:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519757:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519764:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519770:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519776:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519781:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519788:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519794:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519800:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519806:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519812:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519818:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519824:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519830:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519836:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519849:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519855:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519861:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519866:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519885:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519891:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519897:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519902:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519907:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519913:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519918:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519924:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519930:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519935:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519941:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519947:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519953:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519958:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519964:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519970:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519976:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519982:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519987:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519993:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.519999:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520005:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520011:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520017:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520040:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520047:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520053:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520058:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520064:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520070:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520076:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520088:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520095:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520102:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520107:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520113:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520118:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520124:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788535983.520130:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788535983.524121:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788535983.524134:0:15416:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788535983.524138:0:15416:0:(genops.c:885:class_export_put()) final put ffff90058a00b800/MDS_uuid 00000020:00000080:2.0:1788535983.524142:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff90058a00b800/MDS_uuid for MDS 00000020:01000000:2.0:1788535983.524295:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788535983.524449:0:15416:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788535984.307236:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535985.325306:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535986.348248:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788535986.350858:0:15616:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788535986.367194:0:15616:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788535986.367256:0:15616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535986.367271:0:15616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535986.367278:0:15616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535986.367286:0:15616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788535986.367306:0:15616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788535986.367311:0:15616:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788535986.367333:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788535986.367338:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788535986.367344:0:15616:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788535986.367350:0:15616:0:(import.c:65:import_set_state_nolock()) ffff90048680f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788535986.367355:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788535986.367357:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788535986.367372:0:15616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788535986.368693:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788535986.368705:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535986.368717:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3fe00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788535986.368721:0:6523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535986.368731:0:6523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788535986.368739:0:6523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788535986.368745:0:6523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788535986.368749:0:6523:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788535986.368752:0:6523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788535986.368777:0:6523:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9005aca94800 00010000:00010000:2.0:1788535986.368781:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535986.368788:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3fe00/0xe79af2f39bbdc48f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc496 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535986.368806:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535986.368809:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535986.368812:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788535986.368820:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788535986.368825:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788535986.368830:0:15616:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788535986.368852:0:15616:0:(import.c:65:import_set_state_nolock()) ffff90048695a800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788535986.368898:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3659:1875415569433728:0@lo:39:umount.0 00000400:00000100:0.0:1788535986.368948:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415569433728 offset 0 length 224: 4 00010000:00010000:2.0:1788535987.372352:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788535988.140489:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788535988.140500:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788535988.140502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788535988.140505:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788535988.140509:0:37:0:(import.c:65:import_set_state_nolock()) ffff90059fa9a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788535988.140518:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 441 00000100:00080000:0.0:1788535988.140523:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788535988.140530:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90059fa9a000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788535988.140571:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900481cff800 x1875415569433856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788535988.140690:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788535988.140707:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569433984:0@lo:400:kworker.0 00000100:00100000:3.0:1788535988.140735:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3659:1875415569433856:0@lo:38:kworker.0 00000400:00000100:2.0:1788535988.140757:0:3660:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415569433984 offset 0 length 224: 4 00000400:00000100:3.0:1788535988.140779:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415569433856 offset 0 length 520: 4 00010000:00010000:3.0:1788535988.398588:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788535989.165551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788535989.165561:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788535989.165564:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788535989.165566:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788535989.165672:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788535989.165691:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569434112:0@lo:400:kworker.0 00000400:00000100:3.0:1788535989.165746:0:3663:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415569434112 offset 0 length 224: 4 00000001:00100000:3.0:1788535989.166508:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788535989.166514:0:9525:0:(genops.c:885:class_export_put()) final put ffff90059fa98000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788535989.166580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90059fa98000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788535989.166625:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90059fa9b000 for lustre-OST0001 00000001:00100000:0.0:1788535989.167940:0:8441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788535989.167948:0:8441:0:(genops.c:885:class_export_put()) final put ffff900486958000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788535989.170429:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900486958000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788535989.171925:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90048695a000 for lustre-OST0000 00010000:00010000:2.0:1788535989.420495:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535990.444551:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535991.468409:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535992.492468:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788535993.196625:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788535993.196634:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788535993.196638:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788535993.196641:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788535993.196738:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569434240:0@lo:400:kworker.0 00000400:00000100:3.0:1788535993.196789:0:3663:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415569434240 offset 0 length 224: 4 00000100:00100000:0.0:1788535993.260246:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788535983/real 1788535983] req@ffff900481cfdf80 x1875415569433600/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788535993 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788535993.260279:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff900481cfdf80 x1875415569433600/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788535993 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788535993.260322:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005aca94800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788535993.260354:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788535993.260358:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89006101-b582-4041-a87b-c8866dc8e13c:3659:1875415569433600:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788535993.265460:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788535993.265470:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788535993.265492:0:37:0:(import.c:65:import_set_state_nolock()) ffff9005aca94800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788535993.265500:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 442 00000100:00080000:2.0:1788535993.265506:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788535993.265514:0:37:0:(import.c:665:import_select_connection()) MGC192.168.203.113@tcp: import ffff9005aca94800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788535993.265549:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb79880 x1875415569434368/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788535993.265582:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788535993.265586:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788535993.265638:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89006101-b582-4041-a87b-c8866dc8e13c:3659:1875415569434368:0@lo:250:kworker.0 00000400:00000100:0.0:1788535993.265689:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875415569434368 offset 0 length 520: 4 00000100:00100000:1.0:1788535993.267706:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569434496:0@lo:400:kworker.0 00000400:00000100:1.0:1788535993.267759:0:3660:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415569434496 offset 0 length 224: 4 00010000:00010000:2.0:1788535993.516601:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535994.540310:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535995.566604:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788535996.337486:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788535986/real 1788535986] req@ffff90048891d500 x1875415569433728/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788535996 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788535996.337527:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90048891d500 x1875415569433728/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788535996 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788535996.337553:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90048695a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788535996.337584:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3659:1875415569433728:0@lo:39:umount.0 00000100:00080000:2.0:1788535996.337687:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788535996.337695:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788535996.337701:0:15616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788535996.338810:0:15616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535996.338830:0:15616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535996.338838:0:15616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535996.338849:0:15616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535996.338882:0:15616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788535996.338893:0:15616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535996.338923:0:15616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535996.338930:0:15616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535996.338939:0:15616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788535996.338961:0:15616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788535996.338966:0:15616:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788535996.338989:0:15616:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788535996.338993:0:15616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788535996.338997:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535996.339002:0:15616:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788535996.339006:0:15616:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9005b7a7cd40) has no exports 00000020:00080000:2.0:1788535996.339027:0:15616:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9005b7a7cd40) has no exports 00010000:00010000:1.0:1788535996.340264:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788535996.340275:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535996.340285:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e461c00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535996.340293:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535996.340308:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535996.340315:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535996.340352:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788535996.340355:0:9533:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788535996.340358:0:9533:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788535996.340373:0:9533:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9005aca94800 00010000:00010000:1.0:1788535996.340376:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535996.340382:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e461c00/0xe79af2f39bbdc49d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc4a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535996.340397:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788535996.340400:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535996.340405:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e460c00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788535996.340407:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535996.340413:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788535996.340419:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788535996.340423:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788535996.340425:0:9533:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788535996.340427:0:9533:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788535996.340431:0:9533:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9005aca94800 00010000:00010000:1.0:1788535996.340434:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535996.340446:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e460c00/0xe79af2f39bbdc721 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc728 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788535996.340466:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535996.340468:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535996.340470:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788535996.340898:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788535996.343919:0:15616:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff900486bf0000 - data ffff900486046a20/ffff90059fb2cc00 00000020:01000000:3.0:1788535996.360332:0:15616:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff900486a161e0 - data ffff9005bb6bae58/ffff900486955c00 00100000:10000000:0.0:1788535996.414999:0:15616:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788535996.424058:0:15616:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc1ef 00000020:00000080:2.0:1788535996.424069:0:15616:0:(genops.c:885:class_export_put()) final put ffff90059e0ee000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788535996.424093:0:15616:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9005893a3800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788535996.424096:0:15616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9005893a3800 2 00000020:01000004:2.0:1788535996.424100:0:15616:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9005893a3800 from lustre-OST0000 00000020:00000080:2.0:1788535996.424121:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788535996.424129:0:15616:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788535996.424132:0:15616:0:(genops.c:885:class_export_put()) final put ffff9005bb339800/lustre-OST0000_UUID 00000020:00000080:2.0:1788535996.424135:0:15616:0:(genops.c:844:class_export_destroy()) destroying export ffff9005bb339800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788535996.424141:0:15616:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788535996.424213:0:15616:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788535996.424218:0:15616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788535996.424221:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788535996.424233:0:15616:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788535996.424239:0:15616:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90048695e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788535996.424245:0:15616:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9005baf2b380) has exports, disconnecting them 00000020:00080000:2.0:1788535996.424250:0:15616:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90048695e800), last request at 1788535779 00000020:00000080:2.0:1788535996.424254:0:15616:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc219 00000020:00080000:2.0:1788535996.424262:0:15616:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90048695e800): rc 0 00000020:00000080:2.0:1788535996.424266:0:15616:0:(genops.c:885:class_export_put()) final put ffff90048695e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788535996.424812:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90059e0ee000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788535996.424821:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90048695e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788535996.427622:0:15616:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788535996.427632:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788535996.427636:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788535996.427645:0:15616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788535996.427854:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788535996.427862:0:15616:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788535996.427870:0:15616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788535996.427876:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788535996.427880:0:15616:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788535996.427895:0:15616:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff90048695c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788535996.427902:0:15616:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff90059e5d19c0) has exports, disconnecting them 00000020:00080000:3.0:1788535996.427907:0:15616:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff90048695c000), last request at 1788535779 00000020:00000080:3.0:1788535996.427910:0:15616:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc22e 00000020:00080000:3.0:1788535996.427925:0:15616:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90048695c000): rc 0 00000020:00000080:3.0:1788535996.427930:0:15616:0:(genops.c:885:class_export_put()) final put ffff90048695c000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788535996.428618:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90048680f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788535996.428627:0:36:0:(genops.c:885:class_export_put()) final put ffff9005b780d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788535996.428630:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9005b780d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788535996.428637:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788535996.428693:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90048695c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788535996.525580:0:15616:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788535996.525588:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788535996.525592:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788535996.525600:0:15616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788535996.525785:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535996.525793:0:15616:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788535996.525800:0:15616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9005893a3800 1 00000020:00000080:1.0:1788535996.525807:0:15616:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc1b7 00000020:00000080:1.0:1788535996.525815:0:15616:0:(genops.c:885:class_export_put()) final put ffff90059e397000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788535996.525819:0:15616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788535996.525824:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788535996.525828:0:15616:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788535996.525831:0:15616:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90059e5d0000) has no exports 00000020:00000080:2.0:1788535996.527057:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90048695a800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788535996.527067:0:36:0:(genops.c:885:class_export_put()) final put ffff900486958800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788535996.527070:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff900486958800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788535996.527082:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788535996.527161:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90059e397000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788535996.586102:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788535996.586116:0:15616:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788535996.586129:0:15616:0:(genops.c:885:class_export_put()) final put ffff9005893a4800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788535996.586133:0:15616:0:(genops.c:844:class_export_destroy()) destroying export ffff9005893a4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788535996.586143:0:15616:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788535996.586739:0:15616:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9005893a6800 00000020:02000400:1.0:1788535996.586781:0:15616:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788535996.592339:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788535997.614215:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788535998.385881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788535998.385890:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788535998.385892:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788535998.385895:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788535998.385952:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569434624:0@lo:400:kworker.0 00000400:00000100:1.0:1788535998.385999:0:3661:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415569434624 offset 0 length 224: 4 00010000:00010000:0.0:1788535998.637437:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788535999.663340:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788536000.521002:0:15819:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788536000.549180:0:15819:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788536000.549268:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536000.549284:0:15819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536000.549302:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536000.549311:0:15819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536000.549342:0:15819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788536000.549347:0:15819:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788536000.549371:0:15819:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788536000.549383:0:15819:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff900481cff800 x1875415569433856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788536003 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536000.549401:0:15819:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788536000.549420:0:15819:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788536000.549427:0:15819:0:(import.c:65:import_set_state_nolock()) ffff90059fa9a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788536000.549432:0:15819:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788536000.549437:0:15819:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff900481cff800 x1875415569433856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788536003 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536000.549445:0:15819:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788536000.549448:0:15819:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:2.0:1788536000.550730:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536000.550911:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536000.550921:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e000 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788536000.550925:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536000.550935:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536000.550942:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536000.550948:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788536000.550962:0:9533:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788536000.550967:0:9533:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788536000.550982:0:9533:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9005aca94800 00010000:00010000:2.0:1788536000.550986:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536000.550993:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3e000/0xe79af2f39bbdc473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc47a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536000.551006:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536000.551008:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536000.551010:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536000.551133:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3659:1875415569433856:0@lo:38:kworker.0 00000100:00080000:0.0:1788536000.552229:0:15819:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788536000.552243:0:15819:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff900481cfed80 x1875415569433984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536004 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536000.552265:0:15819:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90059fb7a300 x1875415569434112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536005 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536000.552280:0:15819:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff900481cfce00 x1875415569434240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536009 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536000.552288:0:15819:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90059fb79c00 x1875415569434496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536009 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536000.552308:0:15819:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90048891d500 x1875415569434624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536000.552321:0:15819:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788536000.552524:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569434496:0@lo:400:kworker.0 00000100:00100000:3.0:1788536000.552588:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569434240:0@lo:400:kworker.0 00000100:00080000:0.0:1788536000.552613:0:15819:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788536000.555206:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569433984:0@lo:400:kworker.0 00000100:00100000:1.0:1788536000.555263:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569434624:0@lo:400:kworker.0 00000100:00100000:2.0:1788536000.555724:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569434112:0@lo:400:kworker.0 00000100:00080000:0.0:1788536000.558689:0:15819:0:(import.c:65:import_set_state_nolock()) ffff9005b7b0f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788536000.558791:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3659:1875415569434752:0@lo:39:umount.0 00000400:00000100:3.0:1788536000.558846:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875415569434752 offset 0 length 224: 4 00010000:00010000:0.0:1788536000.689406:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536001.708814:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536002.733773:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788536003.500349:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788536003.500360:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788536003.756374:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536004.781398:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536005.804367:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536006.830525:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536007.853016:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788536008.621051:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788536008.621062:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788536008.748271:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788535993/real 1788535993] req@ffff90059fb79880 x1875415569434368/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788536008 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536008.748302:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90059fb79880 x1875415569434368/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788536008 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788536008.748321:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005aca94800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788536008.748339:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788536008.748359:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89006101-b582-4041-a87b-c8866dc8e13c:3659:1875415569434368:0@lo:250:kworker.0 00000100:00080000:1.0:1788536008.756738:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 89006101-b582-4041-a87b-c8866dc8e13c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788536008.756749:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788536008.756753:0:37:0:(import.c:65:import_set_state_nolock()) ffff9005aca94800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788536008.756761:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788536008.756785:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.113@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788536008.756792:0:37:0:(import.c:665:import_select_connection()) MGC192.168.203.113@tcp: import ffff9005aca94800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788536008.756824:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90048891d500 x1875415569434880/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788536008.760660:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89006101-b582-4041-a87b-c8866dc8e13c:3659:1875415569434880:0@lo:250:kworker.0 00000400:00000100:3.0:1788536008.760718:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875415569434880 offset 0 length 520: 4 00010000:00010000:2.0:1788536008.876396:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536009.902665:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536010.797405:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536000/real 1788536000] req@ffff900481cfdf80 x1875415569434752/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788536010 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536010.797437:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff900481cfdf80 x1875415569434752/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788536010 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788536010.797457:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005b7b0f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788536010.797487:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3659:1875415569434752:0@lo:39:umount.0 00000100:00080000:0.0:1788536010.797788:0:15819:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788536010.797793:0:15819:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788536010.797797:0:15819:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788536010.800030:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536010.800048:0:15819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536010.800055:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536010.800062:0:15819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536010.800091:0:15819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536010.800099:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536010.800106:0:15819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536010.800113:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536010.800120:0:15819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536010.800917:0:15819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788536010.800926:0:15819:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788536010.800973:0:15819:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788536010.800977:0:15819:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788536010.800983:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788536010.800989:0:15819:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788536010.800994:0:15819:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff90059e5d4d40) has no exports 00000020:00080000:0.0:1788536010.801019:0:15819:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff90059e5d4d40) has no exports 00010000:00010000:2.0:1788536010.804519:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788536010.804540:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536010.804552:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3ec00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788536010.804556:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536010.804567:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536010.804576:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536010.804582:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788536010.804602:0:9533:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788536010.804605:0:9533:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788536010.804624:0:9533:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9005aca94800 00010000:00010000:2.0:1788536010.804628:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536010.804861:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90058db3ec00/0xe79af2f39bbdc481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc488 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536010.804878:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536010.804883:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536010.804889:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059e454200 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788536010.804892:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536010.804900:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536010.804907:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536010.804912:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788536010.804915:0:9533:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788536010.804917:0:9533:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788536010.804922:0:9533:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9005aca94800 00010000:00010000:2.0:1788536010.804925:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536010.804932:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e454200/0xe79af2f39bbdc713 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc71a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536010.804952:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536010.804954:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536010.804956:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788536010.814609:0:15819:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff900485d7d9c0 - data ffff90048603cbd0/ffff90059fb26800 00000020:01000000:0.0:1788536010.814779:0:15819:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9004879333c0 - data ffff9005bb6bce58/ffff90059fada000 00010000:00010000:1.0:1788536010.815170:0:6523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788536010.825267:0:15819:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788536010.840014:0:15819:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc315 00000020:00000080:1.0:1788536010.840027:0:15819:0:(genops.c:885:class_export_put()) final put ffff900487547800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788536010.840054:0:15819:0:(tgt_mount.c:187:server_put_mount()) put mount ffff900485fef800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788536010.840058:0:15819:0:(obd_mount.c:710:lustre_put_lsi()) put ffff900485fef800 2 00000020:01000004:1.0:1788536010.840061:0:15819:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff900485fef800 from lustre-OST0001 00000020:00000080:3.0:1788536010.840350:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900487547800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788536010.840581:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788536010.840591:0:15819:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788536010.840595:0:15819:0:(genops.c:885:class_export_put()) final put ffff900487546800/lustre-OST0001_UUID 00000020:00000080:2.0:1788536010.840597:0:15819:0:(genops.c:844:class_export_destroy()) destroying export ffff900487546800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788536010.840605:0:15819:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788536010.840845:0:15819:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 89006101-b582-4041-a87b-c8866dc8e13c->MGS 00010000:00010000:2.0:1788536010.840860:0:15819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff900580030200/0xe79af2f39bbdc06e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc075 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536010.840871:0:15819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff900580030200/0xe79af2f39bbdc06e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc075 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536010.840878:0:15819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788536010.840881:0:15819:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788536010.840883:0:15819:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788536010.840896:0:15819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9005aca94800 00010000:00010000:2.0:1788536010.840900:0:15819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff900580030200/0xe79af2f39bbdc06e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc075 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536010.840916:0:15819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe79af2f39bbdc4ea expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536010.840983:0:15819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe79af2f39bbdc4ea expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536010.840989:0:15819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788536010.841001:0:15819:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788536010.841003:0:15819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788536010.841014:0:15819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9005aca94800 00010000:00010000:2.0:1788536010.841016:0:15819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059e454c00/0xe79af2f39bbdc4e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe79af2f39bbdc4ea expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788536010.841034:0:15819:0:(import.c:65:import_set_state_nolock()) ffff9005aca94800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788536010.841038:0:15819:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788536010.841040:0:15819:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788536010.841041:0:15819:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788536010.841046:0:15819:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788536010.841056:0:15819:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90048891d500 x1875415569434880/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788536028 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788536010.841075:0:15819:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788536010.841277:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:89006101-b582-4041-a87b-c8866dc8e13c:3659:1875415569434880:0@lo:250:kworker.0 00000100:00100000:2.0:1788536010.843335:0:15819:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788536010.843357:0:15819:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788536010.843368:0:15819:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdbf6b 00000020:00000080:2.0:1788536010.843375:0:15819:0:(genops.c:885:class_export_put()) final put ffff90058a00c800/89006101-b582-4041-a87b-c8866dc8e13c 00000020:01000000:2.0:1788536010.843542:0:15819:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.113@tcp (flags='') 00000020:00000080:2.0:1788536010.843549:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788536010.843556:0:15819:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.113@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788536010.843560:0:15819:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9005baf299c0) has no exports 10000000:01000000:1.0:1788536010.843621:0:6531:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788536010.843816:0:15819:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.113@tcp: client import never connected 00000100:00080000:2.0:1788536010.843820:0:15819:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788536010.843823:0:15819:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788536010.843825:0:15819:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788536010.843826:0:15819:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788536010.845276:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90058a00c800/89006101-b582-4041-a87b-c8866dc8e13c for MGC192.168.203.113@tcp 00000020:00000080:2.0:1788536010.846977:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788536010.846991:0:15819:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.113@tcp (uuid 89006101-b582-4041-a87b-c8866dc8e13c) 00000020:01000000:2.0:1788536010.847000:0:15819:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788536010.847007:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788536010.847012:0:15819:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788536010.847020:0:15819:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90048680c000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788536010.847036:0:15819:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff90059fa90000) has exports, disconnecting them 00000020:00080000:2.0:1788536010.847042:0:15819:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90048680c000), last request at 1788535799 00000020:00000080:2.0:1788536010.847046:0:15819:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc33f 00000020:00080000:2.0:1788536010.847064:0:15819:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90048680c000): rc 0 00000020:00000080:2.0:1788536010.847068:0:15819:0:(genops.c:885:class_export_put()) final put ffff90048680c000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788536010.847360:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005aca94800 for MGC192.168.203.113@tcp 00000020:00000080:3.0:1788536010.847368:0:37:0:(genops.c:885:class_export_put()) final put ffff9005aca93000/89006101-b582-4041-a87b-c8866dc8e13c 00000020:00000080:3.0:1788536010.847370:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9005aca93000/89006101-b582-4041-a87b-c8866dc8e13c for MGC192.168.203.113@tcp 00000020:01000000:3.0:1788536010.847377:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.113@tcp (89006101-b582-4041-a87b-c8866dc8e13c) 00000020:00000080:3.0:1788536010.847660:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90048680c000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788536010.858350:0:15819:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788536010.858359:0:15819:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788536010.858363:0:15819:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788536010.858371:0:15819:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788536010.858594:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788536010.858603:0:15819:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788536010.858611:0:15819:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788536010.858618:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788536010.858622:0:15819:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788536010.858630:0:15819:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff90059fa9b800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788536010.858636:0:15819:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff90059e1b4d40) has exports, disconnecting them 00000020:00080000:2.0:1788536010.858640:0:15819:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff90059fa9b800), last request at 1788535799 00000020:00000080:2.0:1788536010.858644:0:15819:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc354 00000020:00080000:2.0:1788536010.858659:0:15819:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90059fa9b800): rc 0 00000020:00000080:2.0:1788536010.858663:0:15819:0:(genops.c:885:class_export_put()) final put ffff90059fa9b800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788536010.858793:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90059fa9a000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788536010.858802:0:37:0:(genops.c:885:class_export_put()) final put ffff90048680b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788536010.858805:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90048680b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788536010.858814:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788536010.858876:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90059fa9b800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788536010.885744:0:15819:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788536010.885754:0:15819:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788536010.885760:0:15819:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788536010.885779:0:15819:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788536010.885823:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9005b7b0f000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788536010.886960:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788536010.888079:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788536010.888127:0:6523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788536010.894480:0:6517:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9005acac2800:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1788536010.908996:0:6518:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff900586e17c00:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1788536010.914861:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.915270:0:6520:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff900591cad800:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1788536010.915331:0:6519:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff900591cad400:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1788536010.915418:0:6521:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff900591cac400:6521] 2 exiting: rc = 0 00000100:00100000:1.0:1788536010.915435:0:10351:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff900487ad6600:10351] 3 exiting: rc = 0 00000100:00100000:1.0:1788536010.915556:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915564:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915570:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915576:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915583:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915604:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915612:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915621:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915630:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915639:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915646:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915653:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915661:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915669:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915677:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915683:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915694:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915700:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915706:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915713:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915719:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915724:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915729:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915733:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915738:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915743:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915748:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915754:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915759:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915834:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915842:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915848:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915853:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915858:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915863:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915869:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915874:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915880:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915885:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915935:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915948:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915954:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915959:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915966:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915973:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915980:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.915990:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916000:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916006:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916011:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916017:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916023:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916028:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916034:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916039:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916045:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916050:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916055:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916060:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916065:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916072:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916078:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916087:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.916094:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788536010.916998:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788536010.917009:0:15819:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788536010.917014:0:15819:0:(genops.c:885:class_export_put()) final put ffff900485ffb000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788536010.917019:0:15819:0:(genops.c:844:class_export_destroy()) destroying export ffff900485ffb000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788536010.917025:0:15819:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788536010.917072:0:15819:0:(obd_mount.c:710:lustre_put_lsi()) put ffff900485fef800 1 00000020:00000080:1.0:1788536010.917077:0:15819:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe79af2f39bbdc2e4 00000020:00000080:1.0:1788536010.917083:0:15819:0:(genops.c:885:class_export_put()) final put ffff900485ff9800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788536010.917093:0:15819:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788536010.917097:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788536010.917109:0:15819:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788536010.917113:0:15819:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9005b7a78000) has no exports 00000020:00000080:2.0:1788536010.918562:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff900485ff9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788536010.955586:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788536010.955599:0:15819:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788536010.955604:0:15819:0:(genops.c:885:class_export_put()) final put ffff900485fe9800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788536010.955608:0:15819:0:(genops.c:844:class_export_destroy()) destroying export ffff900485fe9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788536010.955615:0:15819:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788536010.956294:0:15819:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff900485fef000 00000020:01000000:0.0:1788536010.956316:0:15819:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788536010.956321:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788536010.956325:0:15819:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788536010.956329:0:15819:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90059e5d3380) has no exports 00000020:00000080:0.0:1788536010.956472:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788536010.956479:0:15819:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788536010.956483:0:15819:0:(genops.c:885:class_export_put()) final put ffff90059e393800/OSS_uuid 00000020:00000080:0.0:1788536010.956485:0:15819:0:(genops.c:844:class_export_destroy()) destroying export ffff90059e393800/OSS_uuid for OSS 00000020:01000000:0.0:1788536010.956489:0:15819:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788536010.956543:0:6530:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788536010.956713:0:10017:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9004876fe800:10017] 3 exiting: rc = 0 00000100:00100000:0.0:1788536010.956765:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9005b7b1dc00:8447] 1 exiting: rc = 0 00000100:00100000:2.0:1788536010.956806:0:14733:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff90058f816e00:14733] 4 exiting: rc = 0 00000100:00100000:0.0:1788536010.956844:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9005c19b8c00:8448] 2 exiting: rc = 0 00000100:00100000:1.0:1788536010.956945:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9005b7983c00:8446] 0 exiting: rc = 1 00000100:00100000:3.0:1788536010.957010:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957020:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957026:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957032:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957038:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957044:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957061:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957066:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957072:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957078:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957084:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957091:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957097:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957103:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957108:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957114:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957119:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957125:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957130:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957136:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957141:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957162:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957168:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957173:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957178:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957184:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957189:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957197:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957205:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957213:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957235:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957244:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957250:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957256:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957261:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957268:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957274:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957280:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957286:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957292:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957300:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957315:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957320:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957326:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957331:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957336:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957341:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957346:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957352:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957357:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957361:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957366:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957371:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957375:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957380:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957385:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957389:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957394:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957408:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957414:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957419:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957424:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957429:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.957438:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.958796:0:12164:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9005c1837800:12164] 2 exiting: rc = 0 00000100:00100000:1.0:1788536010.961693:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90059e311600:8450] 1 exiting: rc = 0 00000100:00100000:3.0:1788536010.962404:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90059e1f0800:8449] 0 exiting: rc = 1 00000100:00100000:2.0:1788536010.962492:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962515:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962521:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962527:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962532:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962537:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962542:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962547:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962553:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962558:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962563:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962569:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962575:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962579:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962585:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962590:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962597:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962604:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962610:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962616:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962621:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962631:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962638:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962647:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962656:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962677:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962687:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962692:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962697:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962702:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962707:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962712:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962717:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962722:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962727:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962732:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962745:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962750:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962756:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962766:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962777:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962787:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962798:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962809:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962818:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962827:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962838:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962846:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962853:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962859:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962867:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962877:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962885:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962893:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962901:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962910:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962930:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962939:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962948:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962956:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962964:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962969:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962974:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.962991:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964014:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90059e718800:8452] 1 exiting: rc = 0 00000100:00100000:0.0:1788536010.964350:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff900585e2bc00:8453] 2 exiting: rc = 0 00000100:00100000:2.0:1788536010.964435:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90059e719000:8451] 0 exiting: rc = 1 00000100:00100000:1.0:1788536010.964657:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964664:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964670:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964676:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964681:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964752:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964759:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964765:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964771:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964777:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964782:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964788:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964794:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964807:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964814:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964820:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964825:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964832:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964837:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964843:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964849:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964854:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964860:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964865:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964871:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964877:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964882:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964888:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964893:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964909:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964915:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964921:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964926:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964932:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964939:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964945:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964951:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964970:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964976:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964982:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964987:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964993:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.964999:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965004:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965010:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965016:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965022:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965027:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965033:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965039:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965044:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965049:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965055:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965061:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965067:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965072:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965078:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965083:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965089:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965094:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965100:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965108:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965114:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788536010.965127:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788536010.969555:0:8455:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90059e719a00:8455] 1 exiting: rc = 0 00000100:00100000:3.0:1788536010.969908:0:8454:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90059e718e00:8454] 0 exiting: rc = 1 00000100:00100000:0.0:1788536010.969996:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970014:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970020:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970026:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970032:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970037:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970043:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970048:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970053:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970058:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970064:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970069:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970075:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970080:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970085:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970090:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970095:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970101:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970106:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970111:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970118:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970123:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970129:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970133:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970139:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970328:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970337:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970345:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970354:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970364:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970375:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970384:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970394:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970402:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970408:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970413:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970424:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970430:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970435:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970441:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970449:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970454:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970459:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970477:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970483:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970488:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970494:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970499:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970504:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970510:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970515:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970530:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970536:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970543:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970548:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970553:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970559:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970564:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970569:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970575:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970581:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970586:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970591:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.970600:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788536010.971853:0:8457:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9005b78d9e00:8457] 1 exiting: rc = 0 00000100:00100000:1.0:1788536010.972000:0:8456:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9005b78d8200:8456] 0 exiting: rc = 1 00000100:00100000:0.0:1788536010.972088:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972096:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972108:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972114:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972121:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972127:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972133:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972211:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972229:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972236:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972242:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972248:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972254:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972260:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972267:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972272:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972279:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972284:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972290:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972308:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972315:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972321:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972327:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972333:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972339:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972346:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972352:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972358:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972364:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972371:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972378:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972397:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972403:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972410:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972416:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972422:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972428:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972434:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972440:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972447:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972453:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972460:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972471:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972488:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972495:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972503:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972510:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972516:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972522:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972528:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972534:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972541:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972547:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972553:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972560:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972579:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972587:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972593:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972601:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972608:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972616:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972623:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972630:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788536010.972649:0:15819:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788536010.979841:0:15819:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788536028.605841:0:16584:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788536038.356923:0:17183:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788536038.356930:0:17183:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788536038.356931:0:17183:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788536038.357047:0:17183:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff900586554800 00000020:01000004:2.0:1788536038.357073:0:17183:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788536038.357080:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788536038.357094:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9005b7a7cd40) 00000020:00000080:2.0:1788536038.357108:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788536038.437489:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788536038.438376:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788536038.443393:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788536038.443681:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788536038.444303:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788536038.444568:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788536038.444812:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788536038.445129:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788536038.445567:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788536038.445824:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788536038.449337:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788536038.449893:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788536038.450174:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788536038.450435:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788536038.450981:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788536038.451261:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788536038.451566:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788536038.451791:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788536038.452019:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788536038.452322:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788536038.452656:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788536038.456312:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.460643:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.461264:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.461600:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.461810:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.462107:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.462478:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.462765:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.462963:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.463286:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.463553:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.463901:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.464370:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.464773:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.464976:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.465864:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.466180:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.466406:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.466734:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.466972:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.467205:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.467427:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.467650:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.467864:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788536038.468061:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788536038.469226:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788536038.470422:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788536038.470745:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788536038.470922:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788536038.471488:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788536038.471676:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788536038.471892:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1788536038.472679:0:17183:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788536038.472876:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788536038.472884:0:17183:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788536038.472895:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdd528 00000020:01000004:1.0:1788536038.472900:0:17183:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788536038.472905:0:17183:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788536038.472910:0:17183:0:(tgt_mount.c:101:server_register_mount()) register mount ffff900586554800 from MGS 00000020:01000004:1.0:1788536038.472913:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788536038.472923:0:17183:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90059fa90000) 00000020:00000080:1.0:1788536038.472932:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788536038.472991:0:17183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900586554800 from MGS, refs=2 00080000:01000000:1.0:1788536038.472997:0:17183:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788536038.473002:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdd536 00000100:00100000:1.0:1788536038.473104:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788536038.473276:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788536038.473282:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788536038.473851:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788536038.473859:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788536038.474624:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788536038.474787:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788536038.474792:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788536038.475380:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788536038.475387:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788536038.475735:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788536038.475742:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788536038.476499:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536038.476503:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536038.476505:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536038.476812:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536038.476814:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536038.476816:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536038.477585:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788536038.480935:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788536038.480975:0:17183:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788536038.481846:0:17195:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788536038.481890:0:17183:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788536038.481922:0:17183:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788536038.482592:0:17183:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788536038.482938:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536038.483091:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788536038.483097:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788536038.483603:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788536038.483610:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788536038.484330:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788536038.484338:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788536038.484944:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788536038.484962:0:17183:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:1.0:1788536038.484963:0:17183:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788536038.484988:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:1.0:1788536038.484999:0:17183:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (ffff90059fa94d40) 00000020:00000080:1.0:1788536038.485012:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788536038.485093:0:17183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9005831ff000@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788536038.485262:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:1.0:1788536038.485268:0:17183:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788536038.485375:0:17199:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788536038.496295:0:17202:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788536038.497709:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid 25821a76-2177-4c11-bd6b-eb660028a815) 00000020:00000080:1.0:1788536038.497732:0:17183:0:(genops.c:1385:class_connect()) connect: client 25821a76-2177-4c11-bd6b-eb660028a815, cookie 0xe79af2f39bbdd544 00000100:00080000:1.0:1788536038.497743:0:17183:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788536038.497750:0:17183:0:(import.c:665:import_select_connection()) MGC192.168.203.113@tcp: import ffff9005831ff000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788536038.497782:0:17183:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90048891ca80 x1875415569435008/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788536038.497860:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25821a76-2177-4c11-bd6b-eb660028a815:3659:1875415569435008:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788536038.497932:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788536038.498001:0:17183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 25821a76-2177-4c11-bd6b-eb660028a815->MGS 00000020:01000004:1.0:1788536038.498025:0:17183:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788536038.498040:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788536038.498054:0:17183:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90059fa919c0) 00000020:00000080:1.0:1788536038.498066:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788536038.498255:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569435008 00000100:00100000:2.0:1788536038.498263:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569435008 00000100:00100000:2.0:1788536038.498294:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788536038.498302:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3659:x1875415569435008:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788536038.498325:0:17196:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 25821a76-2177-4c11-bd6b-eb660028a815@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:2.0:1788536038.498348:0:17196:0:(genops.c:1385:class_connect()) connect: client 25821a76-2177-4c11-bd6b-eb660028a815, cookie 0xe79af2f39bbdd552 00000100:00080000:2.0:1788536038.498473:0:17196:0:(import.c:65:import_set_state_nolock()) ffff900586555800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788536038.504174:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+5:3659:x1875415569435008:12345-0@lo:250:mount.lustre.0 Request processed in 5861us (6231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536038.504189:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788536038.510495:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536038.510680:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788536038.510686:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788536038.510893:0:3659:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788536038.510910:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:3.0:1788536038.510918:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788536038.510924:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788536038.510929:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005831ff000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788536038.510932:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788536038.510946:0:3659:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788536038.510955:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25821a76-2177-4c11-bd6b-eb660028a815:3659:1875415569435008:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788536038.511768:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788536038.511778:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788536038.512130:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788536038.512136:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788536038.513086:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788536038.513482:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788536038.513488:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788536038.513914:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788536038.513921:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788536038.544535:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536038.544764:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788536038.544771:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788536038.546122:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788536038.546134:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788536038.546891:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536038.547071:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788536038.547077:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788536038.547543:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788536038.547551:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788536038.548437:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788536038.548583:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788536038.548588:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788536038.548989:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788536038.548996:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788536038.549756:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788536038.549904:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788536038.549910:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788536038.550396:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788536038.550402:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788536038.564509:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788536038.564738:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788536038.564745:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788536038.566009:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788536038.566021:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788536038.566970:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788536038.566980:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788536038.568529:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788536038.568558:0:17183:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788536038.568564:0:17183:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788536038.568666:0:17183:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788536038.568706:0:17183:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788536038.568711:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788536038.568712:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788536038.568714:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788536038.568715:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788536038.568716:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788536038.568717:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788536038.568719:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788536038.568720:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788536038.568722:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788536038.568723:0:17183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788536038.568726:0:17183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788536038.568728:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788536038.568729:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788536038.568730:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788536038.568731:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788536038.568732:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788536038.568734:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788536038.568734:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788536038.568736:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788536038.568737:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788536038.568738:0:17183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788536038.568763:0:17183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788536038.568782:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435136:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788536038.568862:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.568922:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788536038.568992:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569435136 00000100:00100000:2.0:1788536038.569000:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569435136 00000100:00100000:2.0:1788536038.569055:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536038.569065:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+5:17183:x1875415569435136:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788536038.569121:0:17198:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788536038.569125:0:17198:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788536038.569127:0:17198:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788536038.569578:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788536038.569992:0:17198:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788536038.571327:0:17221:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788536038.571333:0:17221:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788536038.571337:0:17221:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788536038.571340:0:17221:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788536038.571551:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788536038.571736:0:17198:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788536038.571746:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788536038.573230:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+5:17183:x1875415569435136:12345-0@lo:253:mount.lustre.0 Request processed in 4159us (4360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.573256:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788536038.573408:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435136:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788536038.573424:0:17183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788536038.573427:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788536038.573438:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788536038.573439:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788536038.573440:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788536038.573442:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788536038.573443:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788536038.573445:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788536038.573446:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788536038.573448:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788536038.573449:0:17183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788536038.573466:0:17183:0:(tgt_mount.c:101:server_register_mount()) register mount ffff900586554800 from lustre-MDT0000 10000000:01000000:1.0:1788536038.573498:0:17183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788536038.573500:0:17183:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788536038.573504:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90059fa94d40 10000000:01000000:1.0:1788536038.573508:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788536038.573515:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90059fa94d40 from 1 10000000:01000000:1.0:1788536038.573518:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788536038.573550:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.573561:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.573571:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.573591:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536038.573638:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.573679:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788536038.573754:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569435264 00000100:00100000:3.0:1788536038.573762:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569435264 00000100:00100000:3.0:1788536038.573802:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788536038.573810:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+5:17183:x1875415569435264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536038.573821:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536038.573843:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632e600/0xe79af2f39bbdd560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd559 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.573865:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632e600/0xe79af2f39bbdd560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd559 expref: 6 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.573875:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632e600/0xe79af2f39bbdd560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd559 expref: 6 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.573884:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632e600, rc 0) 00000100:00100000:3.0:1788536038.573925:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+6:17183:x1875415569435264:12345-0@lo:101:mount.lustre.0 Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536038.573931:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788536038.574042:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536038.574055:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.574064:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.574118:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536038.574343:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.574369:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.574416:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569435392 00000100:00100000:0.0:1788536038.574420:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569435392 00000100:00100000:0.0:1788536038.574444:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788536038.574450:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+6:17183:x1875415569435392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536038.574521:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+6:17183:x1875415569435392:12345-0@lo:501:mount.lustre.0 Request processed in 70us (177us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788536038.574528:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788536038.574618:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435392:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788536038.574641:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788536038.574659:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.574667:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536038.574674:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff900586554800 10000000:01000000:1.0:1788536038.574678:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788536038.574682:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff900586554800 10000000:01000000:1.0:1788536038.574684:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788536038.574686:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff900586554800 from 1 10000000:01000000:1.0:1788536038.574689:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788536038.574704:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f400/0xe79af2f39bbdd567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.574711:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620f400/0xe79af2f39bbdd567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.574718:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620f400/0xe79af2f39bbdd567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.574730:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536038.574762:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.574782:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.574858:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569435520 00000100:00100000:0.0:1788536038.574863:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569435520 00000100:00100000:0.0:1788536038.574883:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788536038.574888:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+6:17183:x1875415569435520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536038.574895:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536038.574907:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488838200/0xe79af2f39bbdd56e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd567 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.574922:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488838200/0xe79af2f39bbdd56e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd567 expref: 7 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.574931:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488838200/0xe79af2f39bbdd56e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd567 expref: 7 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.574938:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838200, rc 0) 00000100:00100000:0.0:1788536038.574971:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+7:17183:x1875415569435520:12345-0@lo:101:mount.lustre.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.574978:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788536038.575056:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536038.575067:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620f400/0xe79af2f39bbdd567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd56e expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.575075:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620f400/0xe79af2f39bbdd567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd56e expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536038.575084:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788536038.575134:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f400/0xe79af2f39bbdd567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd56e expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.575174:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620f400/0xe79af2f39bbdd567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd56e expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536038.575182:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788536038.575186:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788536038.575190:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff900586554800 10000000:01000000:1.0:1788536038.575193:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788536038.575196:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788536038.575197:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788536038.575212:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620fa00/0xe79af2f39bbdd575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.575219:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620fa00/0xe79af2f39bbdd575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.575226:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620fa00/0xe79af2f39bbdd575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.575246:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536038.575274:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.575299:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569435648 00000100:00100000:1.0:1788536038.575303:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569435648 00000100:00100000:1.0:1788536038.575326:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788536038.575332:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+7:17183:x1875415569435648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536038.575339:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536038.575347:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059620ee00/0xe79af2f39bbdd57c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd575 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.575359:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059620ee00/0xe79af2f39bbdd57c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd575 expref: 8 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.575366:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059620ee00/0xe79af2f39bbdd57c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd575 expref: 8 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.575372:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620ee00, rc 0) 00000100:00100000:1.0:1788536038.575395:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+8:17183:x1875415569435648:12345-0@lo:101:mount.lustre.0 Request processed in 63us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536038.575401:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788536038.575429:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788536038.575440:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536038.575449:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620fa00/0xe79af2f39bbdd575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd57c expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.575456:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620fa00/0xe79af2f39bbdd575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd57c expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.575516:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536038.575543:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.575553:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.575721:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569435776 00000100:00100000:0.0:1788536038.575731:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569435776 00000100:00100000:0.0:1788536038.575752:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788536038.575758:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+8:17183:x1875415569435776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536038.575876:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+9:17183:x1875415569435776:12345-0@lo:501:mount.lustre.0 Request processed in 118us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.575883:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536038.576299:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536038.576331:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536038.576375:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.576404:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.576453:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569435904 00000100:00100000:0.0:1788536038.576457:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569435904 00000100:00100000:0.0:1788536038.576483:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788536038.576489:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+9:17183:x1875415569435904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536038.577121:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+9:17183:x1875415569435904:12345-0@lo:503:mount.lustre.0 Request processed in 629us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.577129:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788536038.577388:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569435904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536038.577717:0:17222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17222:1875415569436032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788536038.577767:0:17222:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.577801:0:17222:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788536038.577851:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569436032 00000100:00100000:2.0:1788536038.577857:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569436032 00000100:00100000:2.0:1788536038.577893:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788536038.577902:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+9:17222:x1875415569436032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536038.578543:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+9:17222:x1875415569436032:12345-0@lo:502:llog_process_th.0 Request processed in 640us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536038.578551:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788536038.578634:0:17222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17222:1875415569436032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788536038.578657:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536038.578667:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536038.578670:0:17222:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788536038.578677:0:17222:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788536038.578679:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788536038.578693:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90059fa93380) 00000020:00000080:1.0:1788536038.578707:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788536038.578716:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788536038.578784:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788536038.578791:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdd58a 00000020:00000080:1.0:1788536038.578990:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788536038.578994:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536038.578997:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536038.579004:0:17222:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788536038.579008:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536038.579011:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536038.579012:0:17222:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788536038.579015:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788536038.579023:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9005c06f99c0) 00000020:00000080:1.0:1788536038.579096:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788536038.579102:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788536038.579104:0:17222:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788536038.579106:0:17222:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788536038.579113:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788536038.579299:0:17222:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900586554800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788536038.579313:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9005c06fb380) 00000020:00000080:1.0:1788536038.579322:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788536038.579379:0:17222:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788536038.579385:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdd59f 00000020:00000080:1.0:1788536038.579492:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788536038.579498:0:17222:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788536038.579502:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe79af2f39bbdd5a6 00080000:01000000:1.0:1788536038.579507:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788536038.579510:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdd5ad 00010000:00010000:3.0:1788536038.663783:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788536038.665374:0:17222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1788536038.665722:0:17222:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788536038.666295:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90059e1b0000) 00000020:00000080:3.0:1788536038.666314:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788536038.666401:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788536038.666410:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdd5bb 00000020:00000080:2.0:1788536038.673618:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788536038.677472:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe79af2f39bbdd5c2 00000020:00000080:3.0:1788536038.678604:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788536038.678616:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536038.678622:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536038.678624:0:17222:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788536038.678627:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788536038.678629:0:17222:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788536038.678631:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788536038.678632:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788536038.678633:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788536038.678635:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536038.678637:0:17222:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788536038.678639:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536038.678652:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536038.678654:0:17222:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788536038.678659:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788536038.678700:0:17222:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788536038.678716:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536038.678718:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536038.678719:0:17222:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788536038.678722:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536038.678725:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536038.678726:0:17222:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788536038.678728:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788536038.678733:0:17222:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:00000080:3.0:1788536038.678758:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788536038.678772:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90059e1b3380) 00000020:00000080:3.0:1788536038.678784:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788536038.678789:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788536038.678837:0:17222:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788536038.678842:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788536038.678850:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdd5d0 00010000:00080000:3.0:1788536038.678879:0:17222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9005acd12000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788536038.680943:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788536038.682804:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788536038.682817:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788536038.682850:0:17222:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788536038.682866:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdd5d7 00000100:00080000:2.0:1788536038.682877:0:17222:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788536038.682883:0:17222:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9005acd12000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788536038.682915:0:17222:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb7a300 x1875415569436160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788536038.682981:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569436160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788536038.683071:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536038.683308:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569436160 00000100:00100000:0.0:1788536038.683316:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569436160 00000100:00100000:0.0:1788536038.683352:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788536038.683360:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569436160:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788536038.683374:0:17209:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788536038.686552:0:17222:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788536038.686683:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536038.686699:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.686701:0:17222:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788536038.686706:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788536038.686709:0:17222:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788536038.686710:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788536038.686712:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788536038.686714:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788536038.686717:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.686718:0:17222:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788536038.686721:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788536038.686726:0:17222:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788536038.686730:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.686731:0:17222:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788536038.686735:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788536038.686739:0:17222:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1788536038.686761:0:17222:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788536038.686764:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788536038.686780:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9005b7a78000) 00000020:00000080:2.0:1788536038.686798:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788536038.686803:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788536038.686893:0:17222:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788536038.686899:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788536038.686907:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdd5e5 00010000:00080000:2.0:1788536038.686936:0:17222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90059bfb2800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788536038.687312:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788536038.688578:0:17222:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788536038.688759:0:17222:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788536038.691524:0:17222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788536038.691831:0:17222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788536038.694816:0:17222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788536038.697351:0:17228:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788536038.697360:0:17228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788536038.699367:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788536038.699393:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788536038.699436:0:17222:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788536038.699458:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdd5ec 00000100:00080000:2.0:1788536038.699469:0:17222:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788536038.699476:0:17222:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90059bfb2800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788536038.699513:0:17222:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb79180 x1875415569436288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788536038.699542:0:17222:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788536038.699621:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569436288:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788536038.699674:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569436288 offset 0 length 520: 4 00000020:01000000:2.0:1788536038.699791:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536038.699795:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.699796:0:17222:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788536038.699799:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788536038.699801:0:17222:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788536038.699803:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788536038.699804:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788536038.699806:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788536038.699808:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.699809:0:17222:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788536038.699812:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788536038.699816:0:17222:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788536038.699819:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.699820:0:17222:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788536038.699823:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788536038.699826:0:17222:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1788536038.699846:0:17222:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788536038.699848:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788536038.699859:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9005b7a799c0) 00000020:00000080:2.0:1788536038.699869:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788536038.699873:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788536038.699945:0:17222:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788536038.699951:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788536038.699962:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe79af2f39bbdd5fa 00010000:00080000:2.0:1788536038.699991:0:17222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90059b60e800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788536038.700285:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788536038.700351:0:17222:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788536038.700363:0:17222:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788536038.702844:0:17222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788536038.703056:0:17222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788536038.703328:0:17222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1788536038.708696:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569436160:12345-0@lo:38:llog_process_th.0 Request processed in 25327us (25617us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788536038.708711:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788536038.708814:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005acd12000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788536038.708820:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788536038.708824:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569436160:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788536038.709066:0:17230:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788536038.709071:0:17230:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788536038.711970:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788536038.711986:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788536038.712038:0:17222:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788536038.712058:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdd601 00000100:00080000:2.0:1788536038.712068:0:17222:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788536038.712074:0:17222:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90059b60e800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788536038.714503:0:17222:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb7ad80 x1875415569436416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788536038.714533:0:17222:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788536038.714553:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569436416:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788536038.714619:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569436416 offset 0 length 520: 4 00000020:01000000:2.0:1788536038.714636:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536038.714642:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.714645:0:17222:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788536038.714648:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536038.714651:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.714653:0:17222:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788536038.714655:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788536038.714657:0:17222:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788536038.714659:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536038.714661:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.714662:0:17222:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788536038.714665:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536038.714667:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.714668:0:17222:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788536038.714673:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788536038.714724:0:17222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17222:1875415569436544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536038.714784:0:17222:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536038.714804:0:17222:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058365b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.714840:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569436544 00000100:00100000:0.0:1788536038.714847:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569436544 00000100:00100000:0.0:1788536038.714895:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788536038.714904:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+9:17222:x1875415569436544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788536038.715016:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+9:17222:x1875415569436544:12345-0@lo:502:llog_process_th.0 Request processed in 113us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536038.715043:0:17222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17222:1875415569436544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788536038.715044:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:2.0:1788536038.715068:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536038.715071:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.715073:0:17222:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788536038.715077:0:17222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788536038.715331:0:17183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788536038.715349:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788536038.715401:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620fa00/0xe79af2f39bbdd575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd57c expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.715415:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620fa00/0xe79af2f39bbdd575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd57c expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536038.715420:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff900586554800 from 1 10000000:01000000:1.0:1788536038.715422:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788536038.715442:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.715447:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.715454:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.715462:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569436672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536038.715486:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.715508:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.715581:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569436672 00000100:00100000:0.0:1788536038.715585:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569436672 00000100:00100000:0.0:1788536038.715607:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536038.715615:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+9:17183:x1875415569436672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536038.715624:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536038.715635:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd608 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.715654:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd608 expref: 10 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.715663:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd608 expref: 10 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.715671:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839400, rc 0) 00000100:00100000:0.0:1788536038.715703:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+10:17183:x1875415569436672:12345-0@lo:101:mount.lustre.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.715707:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788536038.715753:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569436672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536038.715762:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.715769:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.716443:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569436800:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788536038.716490:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.716550:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.716607:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569436800 00000100:00100000:0.0:1788536038.716613:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569436800 00000100:00100000:0.0:1788536038.716646:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788536038.716653:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+10:17183:x1875415569436800:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788536038.716666:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788536038.716672:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788536038.716848:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+10:17183:x1875415569436800:12345-0@lo:256:mount.lustre.0 Request processed in 195us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.716856:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788536038.716912:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569436800:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788536038.717944:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788536038.717970:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.717981:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536038.717990:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900586554800 from 1 10000000:01000000:1.0:1788536038.717993:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788536038.718020:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.718039:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.718049:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.718069:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569436928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536038.718118:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.718138:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.718541:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569436928 00000100:00100000:0.0:1788536038.718548:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569436928 00000100:00100000:0.0:1788536038.718582:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788536038.718587:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+10:17183:x1875415569436928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536038.718595:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536038.718605:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd616 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.718622:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd616 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.718629:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd616 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.718634:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839800, rc 0) 00000100:00100000:0.0:1788536038.718668:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+11:17183:x1875415569436928:12345-0@lo:101:mount.lustre.0 Request processed in 80us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.718673:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788536038.718694:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569436928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536038.718706:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.718715:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.718882:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536038.718961:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.718993:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.719005:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569437056 00000100:00100000:0.0:1788536038.719009:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569437056 00000100:00100000:0.0:1788536038.719053:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788536038.719059:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+11:17183:x1875415569437056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536038.719227:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+11:17183:x1875415569437056:12345-0@lo:501:mount.lustre.0 Request processed in 168us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.719234:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788536038.719402:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536038.719429:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536038.719474:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.719499:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788536038.719504:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569437184 00000100:00100000:2.0:1788536038.719509:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569437184 00000100:00100000:2.0:1788536038.719538:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788536038.719545:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+11:17183:x1875415569437184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536038.719638:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+11:17183:x1875415569437184:12345-0@lo:503:mount.lustre.0 Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536038.719645:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788536038.719716:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536038.723917:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17232:1875415569437312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536038.724013:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536038.724203:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.724207:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569437312 00000100:00100000:0.0:1788536038.724214:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569437312 00000100:00100000:0.0:1788536038.724287:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788536038.724298:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+11:17232:x1875415569437312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788536038.724859:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+11:17232:x1875415569437312:12345-0@lo:502:llog_process_th.0 Request processed in 561us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.724868:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788536038.724964:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17232:1875415569437312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788536038.724995:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536038.725004:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.725006:0:17232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788536038.725014:0:17232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff900586554800 00000020:00000080:2.0:1788536038.725017:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788536038.725024:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536038.725035:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.725037:0:17232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788536038.725040:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536038.725052:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.725053:0:17232:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788536038.725057:0:17232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff900586554800 00000020:00000080:2.0:1788536038.725060:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788536038.725303:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536038.725308:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.725310:0:17232:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788536038.725313:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536038.725316:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.725318:0:17232:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788536038.725322:0:17232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff900586554800 00000020:00000080:2.0:1788536038.725324:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788536038.727414:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536038.727429:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.727431:0:17232:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788536038.727436:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788536038.727441:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.727442:0:17232:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788536038.727447:0:17232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff900586554800 00000020:00000080:2.0:1788536038.727449:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788536038.727528:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17232:1875415569437440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536038.727619:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536038.727705:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536038.732994:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569437440 00000100:00100000:1.0:1788536038.733007:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569437440 00000100:00100000:1.0:1788536038.733079:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788536038.733090:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+11:17232:x1875415569437440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788536038.733289:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+11:17232:x1875415569437440:12345-0@lo:502:llog_process_th.0 Request processed in 201us (5670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536038.733297:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788536038.733314:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17232:1875415569437440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788536038.733350:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788536038.733358:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788536038.733360:0:17232:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788536038.733365:0:17232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788536038.733517:0:17183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788536038.733538:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536038.733553:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.733565:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536038.733607:0:17183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788536038.734435:0:17183:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff900586554800 10000000:01000000:1.0:1788536038.734438:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff900586554800 10000000:01000000:1.0:1788536038.734443:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788536038.734448:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff900586554800 from 1 10000000:01000000:1.0:1788536038.734451:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788536038.734490:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f800/0xe79af2f39bbdd624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.734500:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620f800/0xe79af2f39bbdd624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.734509:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620f800/0xe79af2f39bbdd624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.734531:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536038.734587:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.734624:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788536038.736456:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569437568 00000100:00100000:2.0:1788536038.736470:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569437568 00000100:00100000:2.0:1788536038.736523:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788536038.736542:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+11:17183:x1875415569437568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536038.736560:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536038.736577:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488066800/0xe79af2f39bbdd62b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd624 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536038.736604:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488066800/0xe79af2f39bbdd62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd624 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536038.736616:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488066800/0xe79af2f39bbdd62b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd624 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536038.736625:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066800, rc 0) 00000100:00100000:2.0:1788536038.736695:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+12:17183:x1875415569437568:12345-0@lo:101:mount.lustre.0 Request processed in 156us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536038.736701:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788536038.738417:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536038.738442:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620f800/0xe79af2f39bbdd624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd62b expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536038.738454:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620f800/0xe79af2f39bbdd624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd62b expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536038.738525:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536038.738584:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.738623:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788536038.739263:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569437696 00000100:00100000:2.0:1788536038.739271:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569437696 00000100:00100000:2.0:1788536038.739313:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788536038.739322:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+12:17183:x1875415569437696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536038.739454:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+12:17183:x1875415569437696:12345-0@lo:501:mount.lustre.0 Request processed in 133us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536038.739462:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788536038.741247:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536038.741304:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536038.741387:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536038.741436:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788536038.741542:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569437824 00000100:00100000:2.0:1788536038.741549:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569437824 00000100:00100000:2.0:1788536038.741596:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788536038.741605:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+12:17183:x1875415569437824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536038.741710:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+12:17183:x1875415569437824:12345-0@lo:503:mount.lustre.0 Request processed in 105us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536038.741726:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788536038.742376:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569437824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536038.742606:0:17237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17237:1875415569437952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788536038.742658:0:17237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536038.742683:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569437952 00000100:00100000:0.0:1788536038.742687:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569437952 00000100:00100000:0.0:1788536038.742714:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788536038.742722:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+12:17237:x1875415569437952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788536038.742802:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+12:17237:x1875415569437952:12345-0@lo:502:llog_process_th.0 Request processed in 80us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.742809:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788536038.742849:0:17237:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.742862:0:17237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17237:1875415569437952:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788536038.742908:0:17237:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788536038.742922:0:17237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90059e5d3380) 00000020:00000080:0.0:1788536038.742939:0:17237:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788536038.743008:0:17237:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900586554800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788536038.743012:0:17237:0:(tgt_mount.c:187:server_put_mount()) put mount ffff900586554800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788536038.743014:0:17237:0:(obd_mount.c:710:lustre_put_lsi()) put ffff900586554800 4 00010000:00080000:0.0:1788536038.743048:0:17237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff900487bd8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1788536038.744559:0:17237:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788536038.749409:0:17237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788536038.749453:0:17237:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788536038.749466:0:17237:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe79af2f39bbdd639 00000100:00080000:2.0:1788536038.749477:0:17237:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788536038.749483:0:17237:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff900487bd8800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788536038.749517:0:17237:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb78e00 x1875415569438080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788536038.749536:0:17237:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788536038.749584:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569438080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788536038.749649:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536038.752312:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569438080 00000100:00100000:3.0:1788536038.752323:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569438080 00000100:00100000:3.0:1788536038.752355:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536038.752362:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1875415569438080:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788536038.752437:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1875415569438080:12345-0@lo:38:llog_process_th.0 Request processed in 74us (2786us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788536038.752453:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536038.752496:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788536038.752503:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900487bd8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788536038.752507:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788536038.752512:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569438080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788536038.760660:0:17237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17237:1875415569438208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536038.760749:0:17237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536038.760789:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569438208 00000100:00100000:2.0:1788536038.760794:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569438208 00000100:00100000:2.0:1788536038.760839:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788536038.760846:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+12:17237:x1875415569438208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536038.760958:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+12:17237:x1875415569438208:12345-0@lo:502:llog_process_th.0 Request processed in 111us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536038.760965:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788536038.761007:0:17237:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788536038.761024:0:17237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17237:1875415569438208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536038.761072:0:17237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17237:1875415569438336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788536038.761324:0:17237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536038.761380:0:17237:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.761412:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569438336 00000100:00100000:0.0:1788536038.761417:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569438336 00000100:00100000:0.0:1788536038.761475:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788536038.761489:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+12:17237:x1875415569438336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788536038.761568:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+12:17237:x1875415569438336:12345-0@lo:502:llog_process_th.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.761576:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788536038.761658:0:17237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25821a76-2177-4c11-bd6b-eb660028a815:17237:1875415569438336:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788536038.761678:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788536038.761736:0:17183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788536038.761758:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788536038.761814:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f800/0xe79af2f39bbdd624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd62b expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.761825:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620f800/0xe79af2f39bbdd624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd62b expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788536038.761881:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788536038.761883:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788536038.761885:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536038.761886:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536038.761887:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536038.761889:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536038.761890:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788536038.761892:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788536038.761893:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536038.761895:0:17183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788536038.761898:0:17183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788536038.761901:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788536038.761902:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788536038.761903:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536038.761904:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536038.761905:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536038.761906:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536038.761907:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788536038.761908:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788536038.761913:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536038.761914:0:17183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788536038.761926:0:17183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788536038.761936:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569438464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788536038.761968:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536038.762021:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058671d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788536038.762353:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569438464 00000100:00100000:2.0:1788536038.762358:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569438464 00000100:00100000:0.0:1788536038.762486:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788536038.762494:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+12:17183:x1875415569438464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788536038.762515:0:17198:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788536038.762527:0:17198:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788536038.764395:0:17198:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788536038.764418:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788536038.764512:0:17220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788536038.764518:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788536038.764539:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.764557:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd608 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.764567:0:17220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.764602:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd608 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.764616:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd608 expref: 12 pid: 17198 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536038.764629:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569438592:0@lo:104: 00000100:00100000:3.0:1788536038.764688:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536038.764735:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005831353c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536038.764798:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569438592 00000100:00100000:0.0:1788536038.764805:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569438592 00000100:00100000:0.0:1788536038.764842:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788536038.764851:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+3:17220:x1875415569438592:12345-0@lo:104: 00010000:00010000:0.0:1788536038.764865:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.764920:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788536038.764926:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+3:17220:x1875415569438592:12345-0@lo:104: Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.764933:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788536038.764956:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536038.764962:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.764970:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f600 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788536038.764974:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.764996:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788536038.765004:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536038.765010:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788536038.765045:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765052:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788536038.765078:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765086:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd60f expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765114:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536038.765116:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536038.765118:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536038.765140:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536038.765172:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569438720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788536038.765200:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536038.765237:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569438720 00000100:00100000:0.0:1788536038.765242:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569438720 00010000:00010000:0.0:1788536038.765257:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd608 expref: 13 pid: 17198 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536038.765278:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788536038.765291:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+13:3663:x1875415569438720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788536038.765313:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536038.765319:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd608 expref: 13 pid: 17198 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765330:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd608 expref: 13 pid: 17198 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765345:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765353:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788536038.765365:0:17189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000848427s 00010000:00010000:0.0:1788536038.765370:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765377:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765384:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765391:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765397:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632ea00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536038.765401:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765420:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765429:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536038.765439:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536038.765466:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+13:3663:x1875415569438720:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.765473:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788536038.765512:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569438720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788536038.765596:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488839400/0xe79af2f39bbdd60f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd608 expref: 12 pid: 17198 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536038.765606:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569438592:0@lo:104: 00010000:00010000:3.0:1788536038.765627:0:17220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.765635:0:17220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.765641:0:17220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536038.765649:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd640 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536038.766091:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+11:17183:x1875415569438464:12345-0@lo:253:mount.lustre.0 Request processed in 3597us (4120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536038.766108:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788536038.766330:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17183:1875415569438464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788536038.766342:0:17183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788536038.766345:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788536038.766347:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788536038.766348:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536038.766349:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536038.766350:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536038.766351:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536038.766352:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788536038.766354:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788536038.766355:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536038.766356:0:17183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788536038.766365:0:17183:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1788536038.780993:0:17183:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788536038.781459:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788536038.781624:0:17244:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788536038.781629:0:17244:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788536038.781728:0:17245:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788536038.781964:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788536038.782052:0:17245:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788536038.782660:0:17246:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9004888ddf80 x1875415569438848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536038.782673:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00000040:01000000:0.0:1788536038.782989:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788536038.783023:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788536038.783976:0:17183:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788536038.783989:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788536038.784043:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788536038.785483:0:17183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788536038.786044:0:17183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788536038.786080:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788536038.786862:0:17245:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788536038.786921:0:17245:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:0.0:1788536038.787431:0:17183:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788536038.788670:0:17183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788536038.790050:0:17183:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788536038.790089:0:17183:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa58c4169f988 00100000:10000000:0.0:1788536038.790254:0:17183:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788536038.791259:0:17183:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788536038.791274:0:17183:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788536038.791290:0:17183:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788536038.791307:0:17183:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788536038.792051:0:17183:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788536038.792284:0:17183:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788536039.532540:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536039.788267:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00000040:00080000:0.0:1788536039.788883:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788536039.918691:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788536039.918699:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff900586554800 from 7 10000000:01000000:0.0:1788536039.918703:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788536039.918746:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536039.918758:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536039.918770:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536039.918793:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569438976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788536039.918865:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536039.918911:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788536039.919005:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569438976 00000100:00100000:2.0:1788536039.919012:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569438976 00000100:00100000:2.0:1788536039.919074:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788536039.919090:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+11:17202:x1875415569438976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536039.919103:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536039.919116:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd647 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536039.920289:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd647 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536039.920306:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd647 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536039.920316:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066600, rc 0) 00000100:00100000:2.0:1788536039.920389:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+12:17202:x1875415569438976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1306us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536039.920397:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788536039.920509:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569438976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536039.920526:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536039.920536:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536039.920594:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569439104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788536039.920638:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536039.920676:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058abe1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788536039.920736:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569439104 00000100:00100000:0.0:1788536039.920741:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569439104 00000100:00100000:0.0:1788536039.920783:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788536039.920792:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+12:17202:x1875415569439104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788536039.920807:0:17197:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788536039.920820:0:17197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788536039.920824:0:17197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788536039.920895:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+12:17202:x1875415569439104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536039.920910:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788536039.920977:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569439104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788536039.921031:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788536039.921037:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536039.921045:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536040.556623:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788536040.812873:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788536040.813279:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00010000:00010000:0.0:1788536041.581255:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536041.839644:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00010000:00010000:1.0:1788536042.607853:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536042.862569:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00000001:02000400:1.0:1788536043.033977:0:17489:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788536043.628781:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536043.885405:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00000020:00000004:0.0:1788536043.898180:0:17541:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788536043.898498:0:17541:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1788536043.950794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788536043.950802:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788536043.950805:0:8:0:(import.c:65:import_set_state_nolock()) ffff9005acd12000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536043.950813:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:3.0:1788536043.950819:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788536043.950826:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9005acd12000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536043.950853:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9004888dce00 x1875415569439360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788536043.950870:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536043.950873:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536043.950884:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536043.950887:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536043.950889:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788536043.950892:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788536043.950895:0:8:0:(import.c:65:import_set_state_nolock()) ffff900487bd8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536043.950900:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff900487bd8800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536043.950914:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9004888df100 x1875415569439488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788536043.950955:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569439232:0@lo:400:kworker.0 00000100:00100000:3.0:1788536043.951041:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536043.951106:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569439360:0@lo:38:kworker.0 00000100:00100000:3.0:1788536043.951134:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536043.951177:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569439488:0@lo:38:kworker.0 00000100:00100000:3.0:1788536043.951203:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536043.951237:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569439232 00000100:00100000:3.0:1788536043.951244:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569439232 00000100:00100000:3.0:1788536043.951412:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788536043.951422:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+12:3663:x1875415569439232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536043.951469:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+12:3663:x1875415569439232:12345-0@lo:400:kworker.0 Request processed in 49us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536043.951477:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788536043.951520:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569439360 00000100:00100000:3.0:1788536043.951525:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569439360 00000100:00100000:3.0:1788536043.951543:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788536043.951548:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3659:x1875415569439360:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788536043.951573:0:17210:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788536043.953431:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569439488 00000100:00100000:2.0:1788536043.953444:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569439488 00000100:00100000:2.0:1788536043.953477:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536043.953483:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1875415569439488:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788536043.953508:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1788536043.953544:0:17206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe79af2f39bbdd655 00000004:00100000:2.0:1788536043.953557:0:17206:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788536043.953686:0:17206:0:(import.c:65:import_set_state_nolock()) ffff900589400000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788536043.953773:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875415569439488:12345-0@lo:38:kworker.0 Request processed in 288us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536043.953782:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788536043.953842:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9004888df100 x1875415569439488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788536053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788536043.953859:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788536043.953867:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788536043.953871:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788536043.953873:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900487bd8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788536043.953879:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875415569439488:0@lo:38:kworker.0 00000100:00100000:2.0:1788536043.953929:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569439232:0@lo:400:kworker.0 00000100:00100000:2.0:1788536043.983244:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3659:x1875415569439360:12345-0@lo:38:kworker.0 Request processed in 31685us (32098us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788536043.983274:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788536043.984105:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005acd12000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788536043.984114:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788536043.984118:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569439360:0@lo:38:kworker.0 00010000:00010000:1.0:1788536044.652687:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788536044.712425:0:17591:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788536044.712776:0:17591:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788536044.909322:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00010000:00010000:1.0:1788536045.676412:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536045.935023:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00010000:00010000:1.0:1788536046.703564:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536046.963298:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00010000:00010000:0.0:1788536047.725038:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536047.980697:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00000100:00100000:2.0:1788536048.047588:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536038/real 1788536038] req@ffff90059fb7ad80 x1875415569436416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536048.047621:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90059fb7ad80 x1875415569436416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536048.047646:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536038/real 1788536038] req@ffff90059fb79180 x1875415569436288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536048.047662:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90059fb79180 x1875415569436288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788536048.047681:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059b60e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788536048.047716:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788536048.047720:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569436416:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788536048.047726:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059bfb2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788536048.047732:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788536048.047735:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569436288:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788536048.047926:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788536048.047931:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788536048.047935:0:37:0:(import.c:65:import_set_state_nolock()) ffff9005acd12000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788536048.047941:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:0.0:1788536048.047946:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788536048.047954:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9005acd12000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788536048.047984:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900481cfc700 x1875415569439744/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788536048.047996:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536048.048005:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788536048.048007:0:37:0:(import.c:65:import_set_state_nolock()) ffff90059bfb2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788536048.048011:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:0.0:1788536048.048014:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788536048.048017:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90059bfb2800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788536048.048030:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900481cfe680 x1875415569439872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788536048.048038:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536048.048041:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788536048.048042:0:37:0:(import.c:65:import_set_state_nolock()) ffff90059b60e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788536048.048045:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:0.0:1788536048.048048:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788536048.048051:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90059b60e800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788536048.048061:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900481cffb80 x1875415569440000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788536048.048129:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569440128:0@lo:400:kworker.0 00000100:00100000:0.0:1788536048.048213:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536048.048262:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788536048.048268:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569439616:0@lo:400:kworker.0 00000100:00100000:0.0:1788536048.048305:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536048.048395:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569439616 00000100:00100000:2.0:1788536048.048403:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569439616 00000100:00100000:2.0:1788536048.048449:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788536048.048458:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+12:3661:x1875415569439616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536048.048509:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+12:3661:x1875415569439616:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536048.048517:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788536048.048556:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569439616:0@lo:400:kworker.0 00000100:00100000:2.0:1788536048.048575:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569439744:0@lo:38:kworker.0 00000100:00100000:2.0:1788536048.048602:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536048.048619:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569439872:0@lo:8:kworker.0 00000400:00000100:2.0:1788536048.048656:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569439872 offset 0 length 520: 4 00000100:00100000:2.0:1788536048.048675:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569440000:0@lo:8:kworker.0 00000400:00000100:2.0:1788536048.048770:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569440000 offset 0 length 520: 4 00000100:00100000:2.0:1788536048.048794:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569439744 00000100:00100000:2.0:1788536048.048798:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569439744 00000100:00100000:2.0:1788536048.048816:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536048.048821:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569439744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788536048.048838:0:17209:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788536048.051476:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569440128 00000100:00100000:3.0:1788536048.051493:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569440128 00000100:00100000:3.0:1788536048.051543:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536048.051552:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569440128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536048.051641:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569440128:12345-0@lo:400:kworker.0 Request processed in 90us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536048.051648:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788536048.051692:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff900481cfe300 x1875415569440128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536048.051707:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569440128:0@lo:400:kworker.0 00000100:00100000:2.0:1788536048.070825:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569439744:12345-0@lo:38:kworker.0 Request processed in 21994us (22213us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788536048.070839:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788536048.071105:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005acd12000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788536048.071110:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788536048.071115:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569439744:0@lo:38:kworker.0 00010000:00010000:0.0:1788536048.750579:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536049.005804:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00010000:00010000:0.0:1788536049.775224:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536050.029272:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00000040:00080000:0.0:1788536050.030905:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788536050.796361:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788536051.045188:0:17936:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788536051.045193:0:17936:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788536051.045195:0:17936:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788536051.045317:0:17936:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff900590d0d800 00000020:01000004:3.0:1788536051.045334:0:17936:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788536051.045345:0:17936:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788536051.045358:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff90059e1b4d40) 00000020:00000080:3.0:1788536051.045375:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1788536051.052576:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00100000:10000000:3.0:1788536051.088785:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.089860:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788536051.091510:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788536051.091968:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788536051.092188:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788536051.092373:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788536051.092657:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788536051.092963:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788536051.093256:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788536051.093547:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788536051.093796:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788536051.094044:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788536051.094304:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788536051.094544:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788536051.095049:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.095411:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.095758:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.095961:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.096576:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.096828:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.097028:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.097330:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.097605:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.098114:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.098339:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.098579:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.098811:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.099004:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.099505:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.099794:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.099989:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.100212:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.100396:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.100755:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.100955:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.101211:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.101402:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.101760:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.101959:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.102192:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.102512:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.102801:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788536051.103015:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.103327:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.103565:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788536051.103806:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00080000:01000000:3.0:1788536051.105625:0:17936:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788536051.105898:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788536051.105909:0:17936:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788536051.105920:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdd663 00000020:01000004:3.0:1788536051.105926:0:17936:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788536051.105955:0:17936:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788536051.105960:0:17936:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788536051.105966:0:17936:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788536051.105992:0:17936:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788536051.105996:0:17936:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788536051.112955:0:17936:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788536051.112993:0:17936:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788536051.112998:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788536051.112999:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788536051.113001:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536051.113002:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536051.113003:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536051.113004:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536051.113006:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788536051.113008:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536051.113009:0:17936:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788536051.113012:0:17936:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788536051.113014:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788536051.113016:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788536051.113017:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536051.113018:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536051.113019:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536051.113020:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536051.113021:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788536051.113022:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536051.113023:0:17936:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788536051.113112:0:17936:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788536051.113133:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788536051.113312:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536051.113366:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff900481cfa780 going to sleep for 11 seconds 00000100:00100000:1.0:1788536051.113490:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569440256 00000100:00100000:1.0:1788536051.113498:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569440256 00000100:00100000:1.0:1788536051.113578:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788536051.113587:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+12:17936:x1875415569440256:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788536051.113616:0:17196:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788536051.113620:0:17196:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788536051.113628:0:17196:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788536051.114007:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+12:17936:x1875415569440256:12345-0@lo:253:mount.lustre.0 Request processed in 419us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536051.114015:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788536051.114210:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440256:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788536051.114228:0:17936:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788536051.114231:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788536051.114232:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788536051.114234:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536051.114235:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536051.114237:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536051.114238:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536051.114239:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788536051.114241:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536051.114242:0:17936:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788536051.114266:0:17936:0:(tgt_mount.c:101:server_register_mount()) register mount ffff900590d0d800 from lustre-MDT0001 10000000:01000000:0.0:1788536051.114291:0:17936:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788536051.114294:0:17936:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788536051.114300:0:17936:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90059fa94d40 local copy 00010000:00010000:0.0:1788536051.114309:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536051.114386:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536051.114434:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.114726:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.114798:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569440384 00000100:00100000:2.0:1788536051.114804:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569440384 00000100:00100000:2.0:1788536051.114829:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788536051.114837:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+12:17936:x1875415569440384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536051.114907:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+12:17936:x1875415569440384:12345-0@lo:501:mount.lustre.0 Request processed in 70us (472us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788536051.114915:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788536051.115042:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440384:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788536051.115066:0:17936:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788536051.115083:0:17936:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788536051.115088:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.115097:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536051.115120:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff900590d0d800 10000000:01000000:0.0:1788536051.115130:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788536051.115135:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90059fa94d40 10000000:01000000:0.0:1788536051.115138:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788536051.115141:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90059fa94d40 from 1 10000000:01000000:0.0:1788536051.115168:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788536051.115194:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488839e00/0xe79af2f39bbdd66a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.115203:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488839e00/0xe79af2f39bbdd66a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.115211:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488839e00/0xe79af2f39bbdd66a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536051.115224:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788536051.115255:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.115271:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.115369:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569440512 00000100:00100000:2.0:1788536051.115374:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569440512 00000100:00100000:2.0:1788536051.115392:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788536051.115398:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+12:17936:x1875415569440512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536051.115406:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536051.115418:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488067600/0xe79af2f39bbdd671 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd66a expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.115502:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488067600/0xe79af2f39bbdd671 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd66a expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.115512:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488067600/0xe79af2f39bbdd671 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd66a expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.115521:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067600, rc 0) 00000100:00100000:2.0:1788536051.115558:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+13:17936:x1875415569440512:12345-0@lo:101:mount.lustre.0 Request processed in 159us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.115564:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788536051.115673:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536051.115685:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488839e00/0xe79af2f39bbdd66a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd671 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.115694:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488839e00/0xe79af2f39bbdd66a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd671 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536051.115708:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788536051.115723:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488839e00/0xe79af2f39bbdd66a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd671 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.115731:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488839e00/0xe79af2f39bbdd66a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd671 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536051.115749:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff900590d0d800 10000000:01000000:0.0:1788536051.115752:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788536051.115756:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff900590d0d800 from 1 10000000:01000000:0.0:1788536051.115758:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788536051.115772:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838400/0xe79af2f39bbdd678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.115780:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488838400/0xe79af2f39bbdd678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.115787:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488838400/0xe79af2f39bbdd678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536051.115799:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788536051.115825:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.115845:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.115940:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569440640 00000100:00100000:2.0:1788536051.115959:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569440640 00000100:00100000:2.0:1788536051.115977:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788536051.115983:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+13:17936:x1875415569440640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536051.115990:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536051.115998:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488066200/0xe79af2f39bbdd67f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd678 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.116013:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488066200/0xe79af2f39bbdd67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd678 expref: 14 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.116021:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488066200/0xe79af2f39bbdd67f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd678 expref: 14 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.116027:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066200, rc 0) 00000100:00100000:2.0:1788536051.116069:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+14:17936:x1875415569440640:12345-0@lo:101:mount.lustre.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.116074:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788536051.116289:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536051.116299:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488838400/0xe79af2f39bbdd678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd67f expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.116306:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488838400/0xe79af2f39bbdd678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd67f expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536051.116317:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788536051.116331:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838400/0xe79af2f39bbdd678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd67f expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.116339:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488838400/0xe79af2f39bbdd678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd67f expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536051.116352:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788536051.116355:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788536051.116359:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff900590d0d800 10000000:01000000:0.0:1788536051.116361:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788536051.116364:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788536051.116366:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788536051.116379:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838e00/0xe79af2f39bbdd686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.116385:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488838e00/0xe79af2f39bbdd686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.116393:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488838e00/0xe79af2f39bbdd686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536051.116405:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788536051.116537:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.116557:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.116599:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569440768 00000100:00100000:2.0:1788536051.116603:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569440768 00000100:00100000:2.0:1788536051.116636:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788536051.116643:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+14:17936:x1875415569440768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788536051.116650:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536051.116657:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488067c00/0xe79af2f39bbdd68d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd686 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.116680:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488067c00/0xe79af2f39bbdd68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd686 expref: 15 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.116688:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488067c00/0xe79af2f39bbdd68d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd686 expref: 15 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.116701:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067c00, rc 0) 00000100:00100000:2.0:1788536051.116736:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569440768:12345-0@lo:101:mount.lustre.0 Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.116742:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788536051.116846:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536051.116857:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488838e00/0xe79af2f39bbdd686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd68d expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.116865:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488838e00/0xe79af2f39bbdd686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd68d expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788536051.118335:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788536051.118995:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788536051.128540:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788536051.128618:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788536051.128635:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788536051.128650:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788536051.128736:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788536051.128759:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788536051.128773:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788536051.128786:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788536051.128801:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788536051.128814:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788536051.128828:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788536051.128844:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788536051.128859:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788536051.128873:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788536051.128886:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788536051.128902:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788536051.128917:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788536051.128931:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788536051.128956:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788536051.128973:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788536051.128987:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788536051.129001:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788536051.129014:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788536051.129040:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788536051.129046:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788536051.129315:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536051.129388:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.129527:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.129573:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569440896 00000100:00100000:2.0:1788536051.129581:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569440896 00000100:00100000:2.0:1788536051.129675:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788536051.129684:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569440896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536051.129849:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569440896:12345-0@lo:501:mount.lustre.0 Request processed in 165us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.129857:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788536051.129921:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569440896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536051.129961:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569441024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536051.130005:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.130735:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788536051.130766:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569441024 00000100:00100000:1.0:1788536051.130772:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569441024 00000100:00100000:2.0:1788536051.130811:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788536051.130819:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569441024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536051.131597:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569441024:12345-0@lo:503:mount.lustre.0 Request processed in 777us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.131606:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788536051.131718:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569441024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788536051.132136:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788536051.132237:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569441152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536051.132291:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.132323:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788536051.132415:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569441152 00000100:00100000:1.0:1788536051.132421:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569441152 00000100:00100000:1.0:1788536051.132453:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788536051.132459:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569441152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536051.133010:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569441152:12345-0@lo:502:mount.lustre.0 Request processed in 550us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536051.133018:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788536051.133241:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569441152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788536051.133401:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788536051.135574:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788536051.135638:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788536051.135656:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788536051.135688:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788536051.135704:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788536051.135717:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788536051.135730:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788536051.135741:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788536051.135752:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788536051.135770:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788536051.135783:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788536051.135796:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788536051.135811:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788536051.135826:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788536051.135839:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788536051.135853:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788536051.135867:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788536051.135882:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788536051.135898:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788536051.135913:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788536051.135927:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788536051.135957:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788536051.135995:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788536051.136010:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788536051.136022:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788536051.136037:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788536051.136052:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788536051.136068:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788536051.136082:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788536051.136098:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788536051.136112:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788536051.136140:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788536051.138684:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788536051.138712:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788536051.138728:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788536051.138741:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788536051.138754:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788536051.138767:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788536051.138781:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788536051.138794:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788536051.138808:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788536051.138821:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788536051.138833:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788536051.138882:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569441280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536051.138994:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.139039:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.139855:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569441280 00000100:00100000:2.0:1788536051.139863:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569441280 00000100:00100000:2.0:1788536051.139923:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788536051.139933:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569441280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536051.140087:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569441280:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.140095:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788536051.140512:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569441280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536051.140593:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788536051.140606:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788536051.142058:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536051.142072:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.142074:0:17940:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788536051.142080:0:17940:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788536051.142082:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788536051.142095:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9005c06f8000) 00000020:00000080:1.0:1788536051.142113:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788536051.142124:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788536051.142219:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788536051.142226:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdd69b 00000020:00000080:1.0:1788536051.142987:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788536051.142993:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.142997:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.142999:0:17940:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788536051.143002:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536051.143006:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.143008:0:17940:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788536051.143011:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788536051.143019:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9005c06fcd40) 00000020:00000080:1.0:1788536051.143032:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788536051.143037:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788536051.143039:0:17940:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788536051.143041:0:17940:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788536051.143047:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788536051.143095:0:17940:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900590d0d800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788536051.143107:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9005baf299c0) 00000020:00000080:1.0:1788536051.143116:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788536051.144266:0:17940:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788536051.144347:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdd6b0 00000020:00000080:1.0:1788536051.144732:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788536051.144746:0:17940:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788536051.144752:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe79af2f39bbdd6b7 00080000:01000000:1.0:1788536051.144759:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788536051.144763:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdd6be 00010000:00010000:1.0:1788536051.202748:0:17940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788536051.204027:0:17940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788536051.204707:0:17940:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788536051.205758:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788536051.205771:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536051.205777:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536051.205779:0:17940:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788536051.205792:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536051.206064:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536051.206067:0:17940:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788536051.206076:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788536051.206081:0:17940:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:00000080:3.0:1788536051.206118:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788536051.206132:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff90059e1b19c0) 00000020:00000080:3.0:1788536051.206183:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788536051.206192:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788536051.206266:0:17940:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788536051.206273:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788536051.206282:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdd6cc 00010000:00080000:3.0:1788536051.206317:0:17940:0:(ldlm_lib.c:102:import_set_conn()) imp ffff900487bf3800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788536051.210002:0:17940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788536051.214497:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788536051.214512:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788536051.214554:0:17940:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788536051.214574:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdd6d3 00000100:00080000:1.0:1788536051.214584:0:17940:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788536051.214589:0:17940:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff900487bf3800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788536051.214623:0:17940:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90048891ed80 x1875415569441408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788536051.214639:0:17940:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788536051.214694:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.214698:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.214700:0:17940:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788536051.214704:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788536051.214707:0:17940:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788536051.214709:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788536051.214710:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788536051.214711:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788536051.214714:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.214719:0:17940:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788536051.214723:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536051.214727:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.214728:0:17940:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788536051.214731:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788536051.214758:0:17940:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788536051.214788:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.214791:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.214793:0:17940:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788536051.214796:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788536051.214798:0:17940:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788536051.214799:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788536051.214801:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788536051.214802:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788536051.214805:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.214807:0:17940:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788536051.214810:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788536051.214813:0:17940:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788536051.214817:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.214818:0:17940:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788536051.214822:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788536051.214825:0:17940:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1788536051.214848:0:17940:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788536051.214850:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788536051.214862:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9005baf2b380) 00000020:00000080:1.0:1788536051.214875:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788536051.214884:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788536051.214978:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569441408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788536051.215084:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788536051.215201:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788536051.215210:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788536051.215213:0:8:0:(import.c:65:import_set_state_nolock()) ffff9005acd12000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788536051.215217:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1788536051.215221:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1788536051.215221:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569441408 00000100:00080000:2.0:1788536051.215224:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9005acd12000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788536051.215228:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569441408 00000100:00100000:2.0:1788536051.215239:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb78a80 x1875415569441664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788536051.215252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788536051.215255:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788536051.215256:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788536051.215259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788536051.215262:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788536051.215262:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3659:x1875415569441408:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788536051.215281:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569441792:0@lo:400:kworker.0 00010000:00080000:0.0:1788536051.215282:0:17210:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1788536051.215309:0:17210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdd6e1 00000100:00100000:2.0:1788536051.215311:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:0.0:1788536051.215321:0:17210:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788536051.215330:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000001:00000004:0.0:1788536051.215332:0:17210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788536051.215335:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569441536:0@lo:400:kworker.0 00000100:00100000:2.0:1788536051.215367:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536051.215418:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569441792 00000100:00100000:2.0:1788536051.215422:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569441792 00000100:00100000:2.0:1788536051.215459:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536051.215467:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569441792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536051.215517:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569441792:12345-0@lo:400:kworker.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.215524:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536051.215545:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569441536 00000100:00100000:2.0:1788536051.215556:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569441536 00000100:00100000:2.0:1788536051.215590:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788536051.215596:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+15:3663:x1875415569441536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536051.215624:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+15:3663:x1875415569441536:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.215629:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788536051.215654:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569441664:0@lo:38:kworker.0 00000100:00100000:2.0:1788536051.215675:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536051.215705:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569441536:0@lo:400:kworker.0 00010000:00080000:3.0:1788536051.215719:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90059fb78000 x1875415569441792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536051.215728:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569441792:0@lo:400:kworker.0 00000004:00080000:1.0:1788536051.215741:0:17940:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788536051.215751:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788536051.215757:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdd6e8 00000100:00100000:0.0:1788536051.215780:0:17209:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00010000:00080000:1.0:1788536051.215784:0:17940:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9005842b7000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.113@tcp at head 00000100:00100000:0.0:1788536051.215787:0:17209:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:1.0:1788536051.216023:0:17940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788536051.216038:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569441664 00000100:00100000:0.0:1788536051.216043:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569441664 00000100:00100000:3.0:1788536051.216180:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788536051.216186:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3659:x1875415569441664:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788536051.216231:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3659:x1875415569441664:12345-0@lo:38:kworker.0 Request processed in 44us (553us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788536051.216247:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788536051.216351:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788536051.216357:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005acd12000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788536051.216361:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788536051.216364:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569441664:0@lo:38:kworker.0 00000040:01000000:1.0:1788536051.217532:0:17940:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788536051.218181:0:17940:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788536051.220926:0:17940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536051.221138:0:17940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788536051.221431:0:17940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1788536051.222487:0:17946:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788536051.222493:0:17946:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1788536051.222807:0:17210:0:(import.c:65:import_set_state_nolock()) ffff9004878e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788536051.222900:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1875415569441408:12345-0@lo:38:llog_process_th.0 Request processed in 7635us (7815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.222912:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788536051.223009:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788536051.223019:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788536051.223026:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788536051.223031:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788536051.223034:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900487bf3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788536051.223191:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788536051.223204:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569441920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788536051.223250:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536051.223286:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569441920 00000100:00100000:3.0:1788536051.223292:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569441920 00000100:00100000:3.0:1788536051.223324:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788536051.223332:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1875415569441920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788536051.223356:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788536051.223422:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1875415569441920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536051.223429:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788536051.223461:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569441920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788536051.223526:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569441408:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788536051.223742:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788536051.223760:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788536051.223800:0:17940:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788536051.223818:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdd6ef 00000100:00080000:1.0:1788536051.223824:0:17940:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788536051.223829:0:17940:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9005842b7000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788536051.223849:0:17940:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90048891e300 x1875415569442048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788536051.223892:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569442048:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788536051.223915:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569442048 offset 0 length 520: 4 00000100:00080000:1.0:1788536051.223961:0:17940:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788536051.224017:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.224021:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.224023:0:17940:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788536051.224026:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788536051.224029:0:17940:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788536051.224030:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788536051.224032:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788536051.224033:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788536051.224035:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.224037:0:17940:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788536051.224039:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788536051.224043:0:17940:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788536051.224047:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.224048:0:17940:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788536051.224052:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788536051.224065:0:17940:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1788536051.224087:0:17940:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788536051.224090:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788536051.224100:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9005baf2cd40) 00000020:00000080:1.0:1788536051.224111:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788536051.224116:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788536051.224198:0:17940:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788536051.224204:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788536051.224211:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe79af2f39bbdd6fd 00010000:00080000:1.0:1788536051.224237:0:17940:0:(ldlm_lib.c:102:import_set_conn()) imp ffff900589926000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1788536051.224431:0:17940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788536051.224497:0:17940:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788536051.224511:0:17940:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788536051.224877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536051.224883:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536051.224885:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536051.224888:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788536051.226207:0:17940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536051.226452:0:17940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788536051.226568:0:17940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788536051.231242:0:17948:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788536051.231249:0:17948:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788536051.233118:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788536051.233132:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788536051.233197:0:17940:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788536051.233219:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdd704 00000100:00080000:1.0:1788536051.233229:0:17940:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788536051.233236:0:17940:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff900589926000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788536051.233270:0:17940:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90048891df80 x1875415569442176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788536051.233292:0:17940:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788536051.233333:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569442176:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788536051.233385:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569442176 offset 0 length 520: 4 00000100:00080000:3.0:1788536051.233478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536051.233483:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536051.233486:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536051.233488:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788536051.233710:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.233715:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.233717:0:17940:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788536051.233720:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536051.233725:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.233727:0:17940:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788536051.233730:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788536051.233731:0:17940:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788536051.233734:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.233736:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.233737:0:17940:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788536051.233739:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536051.233748:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.233750:0:17940:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788536051.233754:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788536051.233781:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.233784:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.233785:0:17940:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788536051.233788:0:17940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788536051.233987:0:17936:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788536051.234023:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788536051.234044:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838e00/0xe79af2f39bbdd686 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd68d expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.234064:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488838e00/0xe79af2f39bbdd686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd68d expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536051.234073:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff900590d0d800 from 1 10000000:01000000:2.0:1788536051.234075:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788536051.234105:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.234113:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.234122:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536051.234141:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788536051.234361:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536051.234396:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788536051.234417:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569442304 00000100:00100000:0.0:1788536051.234424:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569442304 00000100:00100000:0.0:1788536051.234474:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788536051.234483:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+15:17936:x1875415569442304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536051.234495:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536051.234506:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd70b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.234528:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd70b expref: 16 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.234538:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd70b expref: 16 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.234547:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838c00, rc 0) 00000100:00100000:0.0:1788536051.234591:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+16:17936:x1875415569442304:12345-0@lo:101:mount.lustre.0 Request processed in 109us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.234597:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788536051.234669:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536051.234683:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536051.234691:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536051.235265:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442432:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788536051.235310:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536051.235409:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788536051.235473:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569442432 00000100:00100000:0.0:1788536051.235480:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569442432 00000100:00100000:0.0:1788536051.235516:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788536051.235522:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+16:17936:x1875415569442432:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788536051.235537:0:17198:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788536051.235553:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788536051.235556:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788536051.235641:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+16:17936:x1875415569442432:12345-0@lo:256:mount.lustre.0 Request processed in 118us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.235648:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788536051.235749:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442432:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788536051.240252:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788536051.240278:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536051.240292:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536051.240301:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900590d0d800 from 1 10000000:01000000:1.0:1788536051.240304:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788536051.240348:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536051.240370:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536051.240380:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536051.240405:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536051.240479:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536051.240517:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788536051.240665:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569442560 00000100:00100000:0.0:1788536051.240677:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569442560 00000100:00100000:0.0:1788536051.240720:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788536051.240728:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+16:17936:x1875415569442560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536051.240739:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536051.240752:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd719 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.240774:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd719 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.240784:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd719 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.240791:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838000, rc 0) 00000100:00100000:0.0:1788536051.240837:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569442560:12345-0@lo:101:mount.lustre.0 Request processed in 109us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.240843:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788536051.241034:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536051.241048:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536051.241057:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536051.241216:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536051.241245:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536051.241278:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536051.241301:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788536051.241543:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569442688 00000100:00100000:0.0:1788536051.241548:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569442688 00000100:00100000:0.0:1788536051.241581:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788536051.241596:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569442688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536051.241680:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569442688:12345-0@lo:501:mount.lustre.0 Request processed in 85us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.241687:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788536051.243053:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536051.243105:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536051.243213:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536051.243248:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.243311:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569442816 00000100:00100000:2.0:1788536051.243317:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569442816 00000100:00100000:2.0:1788536051.243348:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788536051.243355:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569442816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536051.243449:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569442816:12345-0@lo:503:mount.lustre.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.243456:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788536051.243661:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442816:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788536051.243989:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536051.244050:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536051.244092:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536051.244258:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788536051.247097:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569442944 00000100:00100000:3.0:1788536051.247111:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569442944 00000100:00100000:3.0:1788536051.247194:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788536051.247204:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569442944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536051.247365:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569442944:12345-0@lo:502:mount.lustre.0 Request processed in 162us (3271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536051.247373:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788536051.247522:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569442944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536051.247764:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788536051.247795:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788536051.247812:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788536051.247828:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788536051.247843:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788536051.247858:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788536051.247874:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788536051.247888:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788536051.247920:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788536051.247937:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788536051.247965:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788536051.248001:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536051.248062:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536051.248092:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.248187:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569443072 00000100:00100000:2.0:1788536051.248198:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569443072 00000100:00100000:2.0:1788536051.248223:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788536051.248230:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569443072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536051.248308:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569443072:12345-0@lo:502:mount.lustre.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.248315:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788536051.248415:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536051.248458:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788536051.248466:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788536051.248869:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536051.248878:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.248880:0:17950:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788536051.248887:0:17950:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff900590d0d800 00000020:00000080:1.0:1788536051.248889:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788536051.248896:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.248903:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.248905:0:17950:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788536051.248907:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536051.248910:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.248911:0:17950:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788536051.248914:0:17950:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff900590d0d800 00000020:00000080:1.0:1788536051.248916:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788536051.248980:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.248983:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.248984:0:17950:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788536051.248987:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536051.248990:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.248991:0:17950:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788536051.248995:0:17950:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff900590d0d800 00000020:00000080:1.0:1788536051.248997:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788536051.249013:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.249016:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.249017:0:17950:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788536051.249019:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536051.249022:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.249023:0:17950:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788536051.249027:0:17950:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff900590d0d800 00000020:00000080:1.0:1788536051.249029:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788536051.249049:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536051.249053:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536051.249054:0:17950:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788536051.249057:0:17950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1788536051.252626:0:17936:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788536051.252671:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788536051.252696:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.252708:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536051.252779:0:17936:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788536051.252782:0:17936:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff900590d0d800 10000000:01000000:2.0:1788536051.252785:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff900590d0d800 10000000:01000000:2.0:1788536051.252789:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788536051.252794:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff900590d0d800 from 1 10000000:01000000:2.0:1788536051.252797:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788536051.252831:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488067800/0xe79af2f39bbdd727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.252840:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488067800/0xe79af2f39bbdd727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.252850:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488067800/0xe79af2f39bbdd727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536051.252874:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788536051.260253:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536051.260369:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569443200 00000100:00100000:3.0:1788536051.260378:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569443200 00000100:00100000:3.0:1788536051.260431:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788536051.260441:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569443200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536051.260456:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536051.260474:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd72e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd727 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.260499:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd727 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.260509:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632ea00/0xe79af2f39bbdd72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd727 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.260517:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632ea00, rc 0) 00000100:00100000:3.0:1788536051.260568:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443200:12345-0@lo:101:mount.lustre.0 Request processed in 129us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536051.260575:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788536051.260619:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536051.260641:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536051.260656:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488067800/0xe79af2f39bbdd727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd72e expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.260677:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488067800/0xe79af2f39bbdd727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd72e expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788536051.261915:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788536051.262239:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788536051.262461:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788536051.262486:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788536051.262502:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788536051.262516:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788536051.262530:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788536051.262545:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788536051.262559:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788536051.262572:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788536051.262586:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788536051.262601:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788536051.262615:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788536051.262629:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788536051.262659:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788536051.262677:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788536051.262691:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788536051.262705:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788536051.262719:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788536051.262733:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788536051.262748:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788536051.262761:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788536051.262775:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788536051.262789:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788536051.262802:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788536051.262818:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788536051.262832:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788536051.262846:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788536051.262871:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788536051.262886:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788536051.262918:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788536051.262925:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788536051.263009:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536051.263069:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536051.263113:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff900582eb10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.263303:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569443328 00000100:00100000:2.0:1788536051.263311:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569443328 00000100:00100000:2.0:1788536051.263347:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788536051.263355:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536051.263459:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443328:12345-0@lo:501:mount.lustre.0 Request processed in 105us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.263467:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788536051.263507:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536051.263538:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536051.263573:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536051.263594:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569443456 00000100:00100000:2.0:1788536051.263597:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569443456 00000100:00100000:2.0:1788536051.263616:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788536051.263622:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536051.263686:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443456:12345-0@lo:503:mount.lustre.0 Request processed in 63us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.263692:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788536051.263729:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.263742:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443456:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788536051.264077:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788536051.264139:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536051.264195:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536051.264217:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569443584 00000100:00100000:2.0:1788536051.264221:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569443584 00000100:00100000:2.0:1788536051.264250:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788536051.264256:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536051.264325:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443584:12345-0@lo:502:mount.lustre.0 Request processed in 69us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.264332:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788536051.264362:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.264375:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788536051.264532:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788536051.264553:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788536051.264564:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788536051.264574:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788536051.264584:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788536051.264594:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788536051.264605:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788536051.264616:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788536051.264642:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788536051.264656:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788536051.264668:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788536051.264680:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788536051.264692:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788536051.264704:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788536051.264718:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788536051.264732:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788536051.264745:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788536051.264757:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788536051.264768:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788536051.264779:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788536051.264790:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788536051.264805:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788536051.264820:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788536051.264844:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788536051.264869:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788536051.264885:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788536051.264899:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788536051.264984:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788536051.265001:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788536051.265013:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788536051.265025:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788536051.265038:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788536051.265050:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788536051.265062:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788536051.265075:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788536051.265088:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788536051.265100:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788536051.265113:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788536051.265125:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788536051.265137:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788536051.265184:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788536051.265201:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788536051.265215:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788536051.265229:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788536051.265248:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788536051.265262:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788536051.265275:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788536051.265288:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788536051.265325:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443712:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536051.265370:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536051.265404:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569443712 00000100:00100000:2.0:1788536051.265409:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569443712 00000100:00100000:2.0:1788536051.265436:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788536051.265443:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536051.265526:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443712:12345-0@lo:502:mount.lustre.0 Request processed in 84us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.265533:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788536051.265569:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.265584:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788536051.265713:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788536051.265733:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788536051.265752:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536051.265784:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536051.265804:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569443840 00000100:00100000:2.0:1788536051.265807:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569443840 00000100:00100000:2.0:1788536051.265828:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788536051.265834:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536051.265890:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569443840:12345-0@lo:502:mount.lustre.0 Request processed in 55us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.265897:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788536051.265927:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.265939:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569443840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788536051.265986:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788536051.265993:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788536051.268342:0:17954:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788536051.268361:0:17954:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9005b7a7b380) 00000020:00000080:2.0:1788536051.268385:0:17954:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788536051.268474:0:17954:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900590d0d800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788536051.268478:0:17954:0:(tgt_mount.c:187:server_put_mount()) put mount ffff900590d0d800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788536051.268481:0:17954:0:(obd_mount.c:710:lustre_put_lsi()) put ffff900590d0d800 3 00010000:00080000:2.0:1788536051.268517:0:17954:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90058940b000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788536051.275609:0:17954:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788536051.279381:0:17954:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788536051.279447:0:17954:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788536051.279462:0:17954:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe79af2f39bbdd73c 00000100:00080000:0.0:1788536051.279473:0:17954:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788536051.279479:0:17954:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90058940b000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788536051.279514:0:17954:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900481cff100 x1875415569443968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788536051.279544:0:17954:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788536051.279684:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536051.279689:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536051.279691:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536051.279694:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788536051.280355:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875415569443968:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788536051.280420:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.285200:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569443968 00000100:00100000:0.0:1788536051.285215:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569443968 00000100:00100000:0.0:1788536051.285260:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788536051.285269:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1875415569443968:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788536051.285296:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1788536051.285329:0:17206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe79af2f39bbdd743 00000004:00100000:0.0:1788536051.285345:0:17206:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788536051.285374:0:17206:0:(import.c:65:import_set_state_nolock()) ffff9004883a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788536051.285448:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875415569443968:12345-0@lo:38:llog_process_th.0 Request processed in 179us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.285457:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788536051.286269:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff900481cff100 x1875415569443968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788536061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536051.286284:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788536051.286293:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788536051.286301:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788536051.286306:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788536051.286308:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90058940b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788536051.286315:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875415569443968:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788536051.287488:0:17954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788536051.288915:0:17936:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788536051.288963:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788536051.290522:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488067800/0xe79af2f39bbdd727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd72e expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536051.290539:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488067800/0xe79af2f39bbdd727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd72e expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788536051.290598:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788536051.290600:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788536051.290601:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536051.290602:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536051.290603:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536051.290605:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536051.290606:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788536051.290608:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536051.290609:0:17936:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788536051.290612:0:17936:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788536051.290620:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788536051.290621:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788536051.290622:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536051.290623:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536051.290623:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536051.290624:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536051.290625:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788536051.290626:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536051.290627:0:17936:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788536051.290652:0:17936:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788536051.290671:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569444096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788536051.290733:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536051.290770:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.290793:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569444096 00000100:00100000:2.0:1788536051.290801:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569444096 00000100:00100000:2.0:1788536051.290841:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788536051.290849:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17936:x1875415569444096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788536051.290874:0:17197:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788536051.290888:0:17197:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788536051.297691:0:17184:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788536051.297969:0:17197:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788536051.297986:0:17197:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788536051.298132:0:17220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788536051.298137:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788536051.298344:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.298365:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd647 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.298373:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd70b expref: 18 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.298381:0:17220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.298420:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd70b expref: 18 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.298445:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd70b expref: 18 pid: 17197 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536051.298460:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569444224:0@lo:104: 00000100:00100000:3.0:1788536051.298524:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788536051.298572:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd647 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.298580:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd647 expref: 18 pid: 17196 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536051.298588:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569444352:0@lo:104: 00000100:00100000:3.0:1788536051.298607:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536051.298623:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff900582eb13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536051.298835:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569444224 00000100:00100000:0.0:1788536051.298842:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569444224 00000100:00100000:0.0:1788536051.298921:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569444352 00000100:00100000:0.0:1788536051.298924:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569444352 00000100:00100000:0.0:1788536051.298963:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788536051.298971:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+4:17220:x1875415569444224:12345-0@lo:104: 00010000:00010000:0.0:1788536051.298984:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299042:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788536051.299048:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+4:17220:x1875415569444224:12345-0@lo:104: Request processed in 78us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.299059:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788536051.299075:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788536051.299081:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+3:17220:x1875415569444352:12345-0@lo:104: 00010000:00010000:0.0:1788536051.299089:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299118:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788536051.299123:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+3:17220:x1875415569444352:12345-0@lo:104: Request processed in 43us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.299128:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788536051.299163:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536051.299169:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299176:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066c00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788536051.299180:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299190:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788536051.299206:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536051.299211:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788536051.299240:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299247:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788536051.299264:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299271:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff900488066c00/0xe79af2f39bbdd70b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd712 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299281:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536051.299285:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299290:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838a00 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788536051.299293:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299299:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788536051.299306:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536051.299311:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788536051.299330:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299335:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788536051.299352:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299358:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd64e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299370:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536051.299372:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536051.299373:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536051.299379:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536051.299385:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788536051.299396:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569444480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788536051.299423:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.299449:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569444480 00000100:00100000:0.0:1788536051.299452:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569444480 00010000:00010000:0.0:1788536051.299468:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd70b expref: 19 pid: 17197 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536051.299490:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788536051.299497:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+19:3660:x1875415569444480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788536051.299506:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536051.299512:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd70b expref: 19 pid: 17197 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299522:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd70b expref: 19 pid: 17197 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.299546:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536051.299572:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+19:3660:x1875415569444480:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.299579:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788536051.299614:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569444480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788536051.299894:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488838c00/0xe79af2f39bbdd712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd70b expref: 18 pid: 17197 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536051.299904:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569444224:0@lo:104: 00000100:00100000:2.0:1788536051.299915:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569444352:0@lo:104: 00010000:00010000:2.0:1788536051.299932:0:17220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536051.300216:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+17:17936:x1875415569444096:12345-0@lo:253:mount.lustre.0 Request processed in 9367us (9482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.300234:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788536051.300273:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:17936:1875415569444096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788536051.300284:0:17936:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788536051.300286:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788536051.300289:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788536051.300290:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788536051.300291:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788536051.300292:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788536051.300293:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788536051.300294:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788536051.300296:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788536051.300297:0:17936:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788536051.300312:0:17936:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788536051.300513:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569444608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788536051.300546:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.301283:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569444608 00000100:00100000:0.0:1788536051.301291:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569444608 00010000:00010000:0.0:1788536051.301316:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd647 expref: 17 pid: 17196 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536051.301340:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788536051.301348:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25821a76-2177-4c11-bd6b-eb660028a815+17:3662:x1875415569444608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788536051.301360:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536051.301365:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd647 expref: 17 pid: 17196 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301375:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd647 expref: 17 pid: 17196 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301389:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488066600/0xe79af2f39bbdd64e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd647 expref: 17 pid: 17196 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301402:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301411:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788536051.301427:0:17191:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003290456s 00010000:00010000:0.0:1788536051.301439:0:17191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301447:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301455:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301462:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301468:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536051.301473:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301481:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301504:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536051.301515:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536051.301558:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25821a76-2177-4c11-bd6b-eb660028a815+16:3662:x1875415569444608:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.301566:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788536051.301748:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569444608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788536051.301776:0:17220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.301784:0:17220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536051.301790:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632f400/0xe79af2f39bbdd74a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1788536051.310478:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788536051.310543:0:17962:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788536051.310547:0:17962:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788536051.310991:0:17963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788536051.311120:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788536051.311480:0:17964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875415569444736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788536051.311545:0:17964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536051.311579:0:17964:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058934fa80 going to sleep for 11 seconds 00000040:01000000:3.0:1788536051.311698:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788536051.311732:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788536051.311848:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569444736 00000100:00100000:0.0:1788536051.311858:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569444736 00000100:00100000:0.0:1788536051.311922:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788536051.311932:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17964:x1875415569444736:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788536051.312027:0:17963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788536051.312083:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17964:x1875415569444736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 152us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.312099:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788536051.312143:0:17964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875415569444736:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788536051.312188:0:17964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788536051.312216:0:17964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875415569444864:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788536051.312248:0:17964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536051.312270:0:17964:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.313204:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569444864 00000100:00100000:2.0:1788536051.313272:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569444864 00000100:00100000:2.0:1788536051.313318:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788536051.313327:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17964:x1875415569444864:12345-0@lo:1000:lod0001_rec0000.0 00000004:00000080:3.0:1788536051.313447:0:17936:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:2.0:1788536051.313905:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17964:x1875415569444864:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 580us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.313912:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788536051.313967:0:17964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875415569444864:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788536051.314168:0:17964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17964:1875415569444992:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788536051.314200:0:17964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536051.314285:0:17964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788536051.314667:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569444992 00000100:00100000:2.0:1788536051.314673:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569444992 00000100:00100000:2.0:1788536051.314713:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788536051.314722:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17964:x1875415569444992:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788536051.314798:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17964:x1875415569444992:12345-0@lo:900:lod0001_rec0000.0 Request processed in 77us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536051.314807:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1788536051.314833:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788536051.314906:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536051.316004:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788536051.316069:0:17963:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00080000:3.0:1788536051.317104:0:17964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90059fb79f80 x1875415569444992/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788536067 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536051.317122:0:17964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17964:1875415569444992:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788536051.317601:0:17964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875415569445120:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788536051.317797:0:17964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536051.317840:0:17964:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788536051.318582:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569445120 00000100:00100000:0.0:1788536051.318593:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569445120 00000100:00100000:0.0:1788536051.318644:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788536051.318655:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17964:x1875415569445120:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788536051.318759:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17964:x1875415569445120:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 105us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536051.318767:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788536051.319018:0:17964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875415569445120:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788536051.319078:0:17964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788536051.321231:0:17964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788536051.321302:0:17964:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788536051.321307:0:17964:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:2.0:1788536051.322796:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788536051.323766:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788536051.323803:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788536051.324106:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788536051.324731:0:17936:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:1.0:1788536051.326614:0:17936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788536051.328551:0:17936:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788536051.328586:0:17936:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa58c41c6b988 00100000:10000000:0.0:1788536051.328594:0:17936:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788536051.329770:0:17936:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788536051.329807:0:17936:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788536051.329825:0:17936:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788536051.329851:0:17936:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788536051.339176:0:17936:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788536051.339491:0:17936:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788536051.822230:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536052.077665:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00000040:00080000:3.0:1788536052.344720:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788536052.846365:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536053.109058:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 10000000:01000000:3.0:1788536053.292283:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788536053.292296:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff900590d0d800 from 8 10000000:01000000:3.0:1788536053.292303:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788536053.292383:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.292399:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.292414:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536053.292448:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569445248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788536053.292568:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536053.292637:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788536053.292673:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569445248 00000100:00100000:3.0:1788536053.292683:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569445248 00000100:00100000:3.0:1788536053.292768:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788536053.292778:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+16:17202:x1875415569445248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536053.292794:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536053.292811:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd751 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.292844:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd751 expref: 17 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.292859:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd751 expref: 17 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.292872:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632f200, rc 0) 00000100:00100000:3.0:1788536053.292920:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569445248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536053.292941:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788536053.293000:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569445248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536053.293020:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.293030:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536053.293109:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569445376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788536053.293186:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536053.293210:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788536053.293244:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569445376 00000100:00100000:3.0:1788536053.293248:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569445376 00000100:00100000:3.0:1788536053.293273:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788536053.293281:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569445376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788536053.293299:0:17198:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788536053.293321:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788536053.293325:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788536053.293419:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569445376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536053.293428:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788536053.293461:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569445376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788536053.293510:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788536053.293520:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.293530:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788536053.293541:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788536053.293544:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff900586554800 from 8 10000000:01000000:3.0:1788536053.293547:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788536053.293567:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.293575:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.293594:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536053.293610:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569445504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788536053.293637:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536053.293652:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788536053.293665:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569445504 00000100:00100000:3.0:1788536053.293669:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569445504 00000100:00100000:3.0:1788536053.293691:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788536053.293697:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569445504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536053.293705:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536053.293715:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd75f expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.293732:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd75f expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.293741:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd75f expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.293748:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632ee00, rc 0) 00000100:00100000:3.0:1788536053.293775:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:17202:x1875415569445504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536053.293781:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788536053.293810:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569445504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536053.293820:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.293835:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536053.293871:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569445632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788536053.293898:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536053.293912:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486ad0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788536053.293923:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569445632 00000100:00100000:3.0:1788536053.293941:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569445632 00000100:00100000:3.0:1788536053.293964:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788536053.293970:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:17202:x1875415569445632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788536053.293981:0:17198:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788536053.293992:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788536053.293996:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788536053.294060:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:17202:x1875415569445632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536053.294069:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788536053.294097:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569445632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788536053.294128:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788536053.294134:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536053.294142:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536053.358620:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788536053.869356:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536054.130181:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00010000:00010000:1.0:1788536054.894402:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536055.148261:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00000001:02000400:1.0:1788536055.778737:0:18207:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788536055.920000:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536056.172364:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 0 seconds 00000100:00100000:0.0:1788536056.238291:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788536056.238317:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569445760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788536056.238397:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536056.238717:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569445760 00000100:00100000:1.0:1788536056.238726:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569445760 00000100:00100000:1.0:1788536056.238780:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788536056.238789:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569445760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788536056.238833:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788536056.238898:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569445760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536056.238916:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788536056.238966:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569445760:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1788536056.736195:0:18259:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788536056.736410:0:18259:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788536056.753033:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569445888:0@lo:400:kworker.0 00000100:00100000:0.0:1788536056.753104:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536056.753326:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569445888 00000100:00100000:3.0:1788536056.753334:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569445888 00000100:00100000:3.0:1788536056.753391:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788536056.753402:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:3660:x1875415569445888:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788536056.753486:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788536056.753491:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788536056.753494:0:37:0:(import.c:65:import_set_state_nolock()) ffff9005acd12000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788536056.753502:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9005acd12000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788536056.753525:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90048891ce00 x1875415569446016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788536056.753548:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536056.753552:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536056.753555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536056.753557:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788536056.753624:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:3660:x1875415569445888:12345-0@lo:400:kworker.0 Request processed in 223us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536056.753632:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788536056.753680:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569446144:0@lo:400:kworker.0 00000100:00100000:3.0:1788536056.753711:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536056.753751:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569446016:0@lo:38:kworker.0 00000100:00100000:2.0:1788536056.753762:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569446144 00000100:00100000:2.0:1788536056.753769:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569446144 00000100:00100000:3.0:1788536056.753782:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536056.753814:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536056.753822:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569446144:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788536056.753854:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536056.753859:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536056.753861:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536056.753864:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788536056.753942:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569446144:12345-0@lo:400:kworker.0 Request processed in 120us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536056.753949:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788536056.754006:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90048891f480 x1875415569446144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536056.754020:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569446144:0@lo:400:kworker.0 00000100:00100000:2.0:1788536056.754219:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569446016 00000100:00100000:2.0:1788536056.754225:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569446016 00000100:00100000:2.0:1788536056.754262:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788536056.754267:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3659:x1875415569446016:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788536056.754296:0:17209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:2.0:1788536056.754332:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdd76d 00000004:00100000:2.0:1788536056.754346:0:17209:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788536056.754350:0:17209:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788536056.754790:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569446272:0@lo:400:kworker.0 00000100:00100000:1.0:1788536056.754835:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536056.755323:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569446272 00000100:00100000:3.0:1788536056.755330:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569446272 00000100:00100000:3.0:1788536056.755370:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788536056.755377:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569446272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536056.755428:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569446272:12345-0@lo:400:kworker.0 Request processed in 51us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536056.755434:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788536056.755468:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90048891c000 x1875415569446272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536056.755479:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569446272:0@lo:400:kworker.0 00000100:00100000:0.0:1788536056.756175:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569445888:0@lo:400:kworker.0 00000100:00080000:0.0:1788536056.784606:0:17209:0:(import.c:65:import_set_state_nolock()) ffff90059061d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788536056.784718:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1875415569446016:12345-0@lo:38:kworker.0 Request processed in 30446us (30932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536056.784730:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788536056.785409:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788536056.785419:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788536056.785424:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788536056.785438:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005acd12000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788536056.785461:0:3659:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000454494d3): req@ffff9004888ddf80 x1875415569438848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536056.785492:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569446016:0@lo:38:kworker.0 00000100:00100000:2.0:1788536056.786134:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788536056.786171:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569446400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788536056.786218:0:17246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536056.786281:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135840 going to sleep for 11 seconds 00000100:00100000:2.0:1788536056.787394:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569438848 00000100:00100000:2.0:1788536056.787417:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569438848 00000100:00100000:2.0:1788536056.787484:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788536056.787495:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17246:x1875415569438848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788536056.787603:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17246:x1875415569438848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 110us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536056.787610:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788536056.787636:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536056.787835:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569446400 00000100:00100000:3.0:1788536056.787840:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569446400 00000100:00100000:3.0:1788536056.787870:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788536056.787881:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569446400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788536056.787913:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788536056.787960:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569446400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536056.787968:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788536056.788009:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569446400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788536056.790250:0:17246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875415569438848:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788536056.790309:0:17246:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788536056.790360:0:17246:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875415569446528:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788536056.790419:0:17246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536056.790458:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788536056.790641:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569446528 00000100:00100000:0.0:1788536056.790647:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569446528 00000100:00100000:0.0:1788536056.790689:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788536056.790698:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17246:x1875415569446528:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788536056.790819:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17246:x1875415569446528:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 121us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536056.790827:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788536056.790856:0:17246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875415569446528:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788536056.790928:0:17246:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875415569446656:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788536056.790964:0:17246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536056.790990:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788536056.791071:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569446656 00000100:00100000:3.0:1788536056.791076:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569446656 00000100:00100000:3.0:1788536056.791102:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788536056.791111:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17246:x1875415569446656:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788536056.791187:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17246:x1875415569446656:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536056.791193:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788536056.791809:0:17246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875415569446656:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788536056.791856:0:17246:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788536056.805608:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788536056.805692:0:17246:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:0.0:1788536056.805697:0:17246:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788536056.942754:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788536057.728804:0:18310:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788536057.730325:0:18310:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788536057.964539:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788536058.783085:0:18358:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe4a1ef30 20000000:00000080:2.0:1788536058.783103:0:18358:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9005b98be400 uarg=0000000000000000 20000000:01000000:2.0:1788536058.783177:0:18358:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788536058.783185:0:18358:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788536058.783189:0:18358:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788536058.788461:0:18359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788536058.792566:0:18358:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788536058.807200:0:18358:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788536058.807254:0:18358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536058.807272:0:18358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd616 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536058.807280:0:18358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd719 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536058.807288:0:18358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536058.807331:0:18358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd719 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536058.807360:0:18358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd719 expref: 17 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536058.807376:0:18358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18358:1875415569446784:0@lo:104: 00000100:00100000:2.0:1788536058.807439:0:18358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788536058.807500:0:18358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd616 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536058.807508:0:18358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd616 expref: 17 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536058.807518:0:18358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18358:1875415569446912:0@lo:104: 00000100:00100000:2.0:1788536058.807539:0:18358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536058.807566:0:18358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788536058.807967:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569446784 00000100:00100000:0.0:1788536058.807977:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569446784 00000100:00100000:0.0:1788536058.808016:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569446912 00000100:00100000:0.0:1788536058.808018:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569446912 00000100:00100000:0.0:1788536058.808031:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788536058.808040:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+4:18358:x1875415569446784:12345-0@lo:104: 00010000:00010000:0.0:1788536058.808055:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.808122:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788536058.808128:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+4:18358:x1875415569446784:12345-0@lo:104: Request processed in 89us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.808134:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788536058.808173:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788536058.808179:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+3:18358:x1875415569446912:12345-0@lo:104: 00010000:00010000:0.0:1788536058.808187:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.808390:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788536058.808397:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+3:18358:x1875415569446912:12345-0@lo:104: Request processed in 218us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.808414:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788536058.811722:0:18358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18358:1875415569446784:0@lo:104: 00000100:00100000:2.0:1788536058.811740:0:18358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18358:1875415569446912:0@lo:104: 00010000:00010000:2.0:1788536058.811775:0:18358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.819084:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788536058.819099:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.819111:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f600 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788536058.819116:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.819127:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788536058.819134:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536058.819172:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788536058.819389:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.819396:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788536058.819456:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788536058.819476:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.819483:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd719 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd720 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.819494:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536058.819497:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.819502:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f200 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788536058.819505:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.819511:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788536058.819516:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536058.819521:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788536058.819538:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.819543:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788536058.819602:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536058.819652:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788536058.819679:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569447168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536058.819744:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536058.819843:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569447168 00000100:00100000:0.0:1788536058.819849:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569447168 00010000:00010000:0.0:1788536058.819898:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd616 expref: 18 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536058.819930:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788536058.819939:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25821a76-2177-4c11-bd6b-eb660028a815+18:3660:x1875415569447168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788536058.819950:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536058.819955:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd616 expref: 18 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.819965:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd616 expref: 18 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.819979:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488839800/0xe79af2f39bbdd61d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd616 expref: 18 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.819991:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536058.820028:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25821a76-2177-4c11-bd6b-eb660028a815+17:3660:x1875415569447168:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.820035:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788536058.820070:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569447168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788536058.822019:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569447040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788536058.822087:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536058.822243:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569447040 00000100:00100000:0.0:1788536058.822250:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569447040 00010000:00010000:0.0:1788536058.822284:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd719 expref: 17 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536058.822337:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788536058.822346:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25821a76-2177-4c11-bd6b-eb660028a815+17:3661:x1875415569447040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788536058.822360:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536058.822365:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd719 expref: 17 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822376:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd719 expref: 17 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822390:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488838000/0xe79af2f39bbdd720 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd719 expref: 17 pid: 17198 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822404:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822412:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822428:0:17190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822435:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822442:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822449:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822465:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536058.822469:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822477:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822490:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536058.822499:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536058.822531:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25821a76-2177-4c11-bd6b-eb660028a815+16:3661:x1875415569447040:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536058.822538:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788536058.822609:0:18358:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536058.822617:0:18358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536058.822634:0:18358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488066c00/0xe79af2f39bbdd774 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536058.825770:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569447040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536058.828144:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.828173:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd616 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd61d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536058.828196:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536058.828198:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536058.828201:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536058.989300:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536060.019429:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788536060.285725:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788536060.289374:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788536060.289384:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900590d0d800 from 13 10000000:01000000:0.0:1788536060.289391:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788536060.289449:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536060.289461:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536060.289472:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536060.289497:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788536060.289580:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536060.289625:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788536060.292272:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569447296 00000100:00100000:3.0:1788536060.292288:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569447296 00000100:00100000:3.0:1788536060.292351:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788536060.292375:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+16:17202:x1875415569447296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536060.292395:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536060.292415:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd77b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536060.292443:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd77b expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536060.292454:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd77b expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536060.292463:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632fe00, rc 0) 00000100:00100000:3.0:1788536060.292545:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569447296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (2965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536060.292552:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788536060.292662:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536060.292682:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536060.292692:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536060.292765:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536060.292799:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536060.292836:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900591f970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536060.294196:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569447424 00000100:00100000:0.0:1788536060.294208:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569447424 00000100:00100000:0.0:1788536060.294262:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788536060.294270:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569447424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788536060.294414:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569447424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536060.294422:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788536060.295907:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536060.295972:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536060.296045:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536060.296086:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900591f970c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536060.298301:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569447552 00000100:00100000:3.0:1788536060.298315:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569447552 00000100:00100000:3.0:1788536060.298375:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788536060.298384:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569447552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788536060.298536:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569447552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536060.298544:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788536060.299714:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788536060.311088:0:18410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788536060.311392:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788536060.311414:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536060.311429:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536060.311456:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536060.311466:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788536060.311469:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900586554800 from 13 10000000:01000000:1.0:1788536060.311472:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788536060.311509:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536060.311517:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536060.311527:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536060.311553:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788536060.311622:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536060.311661:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536060.311810:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569447680 00000100:00100000:2.0:1788536060.311818:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569447680 00000100:00100000:2.0:1788536060.311868:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788536060.311887:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+17:17202:x1875415569447680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536060.311900:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536060.311912:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd789 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536060.311935:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd789 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536060.311955:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd789 expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536060.311962:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067e00, rc 0) 00000100:00100000:2.0:1788536060.312010:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+18:17202:x1875415569447680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536060.312017:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788536060.312264:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536060.312279:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536060.312288:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536060.312336:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536060.312362:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536060.312394:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536060.315634:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569447808 00000100:00100000:2.0:1788536060.315651:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569447808 00000100:00100000:2.0:1788536060.315701:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788536060.315711:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17202:x1875415569447808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788536060.315872:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17202:x1875415569447808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (3508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536060.315907:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788536060.318188:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536060.318245:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536060.318311:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536060.318348:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b7bfbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536060.318554:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569447936 00000100:00100000:2.0:1788536060.318561:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569447936 00000100:00100000:2.0:1788536060.318615:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788536060.318624:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17202:x1875415569447936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788536060.318723:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:17202:x1875415569447936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536060.318730:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788536060.325182:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569447936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788536060.329396:0:18412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788536060.329629:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788536060.329656:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788536060.329672:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536060.329687:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536061.039291:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536061.357386:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536061.357410:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569448064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788536061.357475:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536061.357555:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569448064 00000100:00100000:2.0:1788536061.357563:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569448064 00000100:00100000:2.0:1788536061.357611:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788536061.357620:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569448064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788536061.357651:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788536061.357702:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569448064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536061.357709:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788536061.357750:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569448064:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788536061.878031:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536061.878038:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536061.878041:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536061.878043:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536061.878054:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536061.878058:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536061.878060:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536061.878064:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788536061.878096:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569448192:0@lo:400:kworker.0 00000100:00100000:1.0:1788536061.878184:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536061.878229:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788536061.878235:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569448576:0@lo:400:kworker.0 00000100:00100000:1.0:1788536061.878263:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536061.878297:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569448192 00000100:00100000:1.0:1788536061.878304:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569448192 00000100:00100000:1.0:1788536061.878351:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788536061.878372:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+18:3663:x1875415569448192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536061.878419:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+18:3663:x1875415569448192:12345-0@lo:400:kworker.0 Request processed in 48us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536061.878427:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788536061.878463:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569448576 00000100:00100000:1.0:1788536061.878468:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569448576 00000100:00100000:1.0:1788536061.878494:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788536061.878501:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569448576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536061.878529:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569448576:12345-0@lo:400:kworker.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536061.878536:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788536061.878574:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90048891ce00 x1875415569448576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536061.878588:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569448576:0@lo:400:kworker.0 00000100:00100000:1.0:1788536061.878598:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569448192:0@lo:400:kworker.0 00000100:00100000:0.0:1788536061.880410:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569448320:0@lo:400:kworker.0 00000100:00100000:0.0:1788536061.880468:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536061.880508:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788536061.880515:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569448448:0@lo:400:kworker.0 00000100:00100000:0.0:1788536061.880540:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536061.880571:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569448320 00000100:00100000:0.0:1788536061.880577:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569448320 00000100:00100000:0.0:1788536061.880618:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788536061.880626:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1875415569448320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536061.880673:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1875415569448320:12345-0@lo:400:kworker.0 Request processed in 47us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536061.880680:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788536061.880711:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569448448 00000100:00100000:0.0:1788536061.880714:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569448448 00000100:00100000:0.0:1788536061.880738:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788536061.880743:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569448448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536061.880773:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569448448:12345-0@lo:400:kworker.0 Request processed in 29us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536061.880779:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788536061.882470:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90048891c380 x1875415569448448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536061.882487:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569448448:0@lo:400:kworker.0 00000100:00100000:0.0:1788536061.882509:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569448320:0@lo:400:kworker.0 00000100:00100000:3.0:1788536061.888558:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788536061.888589:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569448704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788536061.888681:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536061.888744:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569448704 00000100:00100000:3.0:1788536061.888755:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569448704 00000100:00100000:3.0:1788536061.888809:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788536061.888825:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569448704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788536061.888883:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788536061.888934:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569448704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536061.888941:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788536061.888991:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569448704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788536061.889185:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536051/real 1788536051] req@ffff90048891df80 x1875415569442176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536061.889206:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90048891df80 x1875415569442176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536061.889217:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536051/real 1788536051] req@ffff90048891e300 x1875415569442048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536061.889227:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90048891e300 x1875415569442048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788536061.889241:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788536061.889257:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788536061.889261:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569442176:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788536061.889266:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005842b7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788536061.889278:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788536061.889282:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569442048:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788536061.889511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536061.889516:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536061.889519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536061.889521:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536061.889524:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536061.889527:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788536061.889530:0:37:0:(import.c:65:import_set_state_nolock()) ffff9005842b7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536061.889534:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:3.0:1788536061.889538:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788536061.889543:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9005842b7000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536061.889571:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9004888ddf80 x1875415569448832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788536061.889594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536061.889597:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788536061.889598:0:37:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536061.889602:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:3.0:1788536061.889604:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788536061.889613:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff900589926000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536061.889627:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9004888dd880 x1875415569448960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788536061.896043:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569448832:0@lo:8:kworker.0 00000400:00000100:0.0:1788536061.896103:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569448832 offset 0 length 520: 4 00000100:00100000:0.0:1788536061.896141:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569448960:0@lo:8:kworker.0 00000400:00000100:0.0:1788536061.896185:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569448960 offset 0 length 520: 4 00010000:00010000:0.0:1788536062.061766:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788536062.396075:0:17937:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788536063.087276:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788536063.597746:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788536063.994258:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536048/real 1788536048] req@ffff900481cfe680 x1875415569439872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536063.994484:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff900481cfe680 x1875415569439872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536063.994509:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536048/real 1788536048] req@ffff900481cffb80 x1875415569440000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536063.994520:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff900481cffb80 x1875415569440000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788536063.994538:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059bfb2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788536063.998919:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788536063.998929:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569439872:0@lo:8:kworker.0 00000100:00080000:0.0:1788536063.998940:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059b60e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788536063.999372:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788536063.999382:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788536063.999384:0:36:0:(import.c:65:import_set_state_nolock()) ffff90059bfb2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788536063.999390:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1788536063.999395:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788536063.999402:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90059bfb2800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788536063.999424:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb7b480 x1875415569449344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788536063.999436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788536063.999439:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788536063.999440:0:36:0:(import.c:65:import_set_state_nolock()) ffff90059b60e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788536063.999443:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1788536063.999446:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788536063.999450:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90059b60e800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788536063.999462:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb79880 x1875415569449472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788536063.999494:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788536063.999498:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788536063.999501:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788536063.999504:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788536063.999533:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569449216:0@lo:400:kworker.0 00000100:00100000:2.0:1788536063.999605:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536063.999657:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788536063.999663:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569449088:0@lo:400:kworker.0 00000100:00100000:2.0:1788536063.999715:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536063.999746:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569449856:0@lo:400:kworker.0 00000100:00100000:2.0:1788536063.999768:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536063.999794:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569449600:0@lo:400:kworker.0 00000100:00100000:2.0:1788536063.999814:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536063.999830:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788536063.999834:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569449728:0@lo:400:kworker.0 00000100:00100000:2.0:1788536063.999851:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536063.999957:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569449216 00000100:00100000:1.0:1788536063.999966:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569449216 00000100:00100000:1.0:1788536064.000010:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788536064.000030:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569449216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536064.000096:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569449216:12345-0@lo:400:kworker.0 Request processed in 77us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536064.000102:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788536064.000132:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569449856 00000100:00100000:1.0:1788536064.000136:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569449856 00000100:00100000:1.0:1788536064.000176:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569449600 00000100:00100000:1.0:1788536064.000179:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569449600 00000100:00100000:1.0:1788536064.000203:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536064.000209:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569449856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536064.000239:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569449856:12345-0@lo:400:kworker.0 Request processed in 31us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536064.000245:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536064.000257:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788536064.000275:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569449600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536064.000301:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569449600:12345-0@lo:400:kworker.0 Request processed in 39us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536064.000307:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788536064.000598:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90059fb79c00 x1875415569449600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536064.000611:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569449600:0@lo:400:kworker.0 00000100:00100000:2.0:1788536064.000640:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569449088 00000100:00100000:2.0:1788536064.000644:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569449088 00000100:00100000:2.0:1788536064.000672:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788536064.000679:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:3661:x1875415569449088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536064.000708:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:3661:x1875415569449088:12345-0@lo:400:kworker.0 Request processed in 30us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536064.000715:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788536064.000754:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569449088:0@lo:400:kworker.0 00010000:00080000:2.0:1788536064.000765:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90059fb7b100 x1875415569449856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536064.000773:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569449856:0@lo:400:kworker.0 00000100:00100000:2.0:1788536064.000782:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569449216:0@lo:400:kworker.0 00000100:00100000:1.0:1788536064.001726:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569449728 00000100:00100000:1.0:1788536064.001735:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569449728 00000100:00100000:1.0:1788536064.001769:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788536064.001776:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569449728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536064.001831:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569449728:12345-0@lo:400:kworker.0 Request processed in 55us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536064.001838:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788536064.002085:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788536064.002091:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569440000:0@lo:8:kworker.0 00000100:00100000:0.0:1788536064.002119:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569449344:0@lo:8:kworker.0 00000400:00000100:0.0:1788536064.002183:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569449344 offset 0 length 520: 4 00000100:00100000:0.0:1788536064.002208:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569449472:0@lo:8:kworker.0 00000400:00000100:0.0:1788536064.002224:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875415569449472 offset 0 length 520: 4 00000100:00100000:3.0:1788536064.002327:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569449728:0@lo:400:kworker.0 00000100:00080000:1.0:1788536064.002531:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536064.002536:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536064.002539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536064.002542:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788536064.108932:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536065.132783:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536066.156704:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536066.476559:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788536066.476582:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569449984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788536066.476647:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536066.476793:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569449984 00000100:00100000:0.0:1788536066.476802:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569449984 00000100:00100000:0.0:1788536066.476858:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788536066.476867:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569449984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788536066.476901:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788536066.476959:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569449984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536066.476974:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788536066.477056:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569449984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788536066.992661:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536066.992680:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569450112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788536066.992765:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536066.992819:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569450112 00000100:00100000:0.0:1788536066.992827:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569450112 00000100:00100000:0.0:1788536066.992885:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788536066.992893:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569450112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788536066.992927:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788536066.992971:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569450112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536066.992978:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788536066.993024:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569450112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788536067.183073:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788536067.205479:0:18706:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788536067.205483:0:18706:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788536067.205484:0:18706:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788536067.205584:0:18706:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9004878ed800 00000020:01000004:1.0:1788536067.205601:0:18706:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788536067.205615:0:18706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788536067.205629:0:18706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9005baf28000) 00000020:00000080:1.0:1788536067.205644:0:18706:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788536067.265281:0:18706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788536067.269851:0:18706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788536067.270544:0:18706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788536067.272747:0:18706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788536067.273074:0:18706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788536067.274604:0:18706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788536067.275004:0:18706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788536067.278797:0:18706:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788536067.279084:0:18706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788536067.279097:0:18706:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788536067.279109:0:18706:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe79af2f39bbdd79e 00000020:01000004:1.0:1788536067.279115:0:18706:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788536067.279137:0:18706:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788536067.279140:0:18706:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788536067.279236:0:18706:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788536067.279241:0:18706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788536067.279252:0:18706:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90059d490000) 00000020:00000080:1.0:1788536067.279265:0:18706:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788536067.280388:0:18706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536067.280548:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788536067.280554:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788536067.287509:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788536067.287523:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788536067.289377:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788536067.289388:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788536067.293409:0:18706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536067.293582:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788536067.293589:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788536067.297750:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788536067.297764:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788536067.345471:0:18706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788536067.347372:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788536067.347385:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788536067.348766:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788536067.348778:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788536067.349760:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788536067.349770:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788536067.352578:0:18706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536067.352789:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788536067.352796:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788536067.367872:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788536067.367901:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788536067.428753:0:18706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788536067.429085:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788536067.429093:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788536067.435084:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788536067.435099:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788536067.435812:0:18706:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788536067.435851:0:18706:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788536067.435858:0:18706:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788536067.453773:0:18706:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788536067.453812:0:18706:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788536067.453817:0:18706:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788536067.453818:0:18706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788536067.453819:0:18706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536067.453820:0:18706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536067.453821:0:18706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536067.456998:0:18706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536067.457000:0:18706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536067.457002:0:18706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536067.457003:0:18706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788536067.457008:0:18706:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788536067.457011:0:18706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788536067.457012:0:18706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788536067.457013:0:18706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536067.457015:0:18706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536067.457016:0:18706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536067.457017:0:18706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536067.457017:0:18706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536067.457018:0:18706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536067.457019:0:18706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788536067.457073:0:18706:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788536067.457093:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450240:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788536067.457187:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.457226:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536067.457370:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569450240 00000100:00100000:1.0:1788536067.457378:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569450240 00000100:00100000:1.0:1788536067.457440:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788536067.457448:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:18706:x1875415569450240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788536067.457494:0:17197:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788536067.457498:0:17197:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788536067.457501:0:17197:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788536067.457990:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+18:18706:x1875415569450240:12345-0@lo:253:mount.lustre.0 Request processed in 541us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.457999:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788536067.462331:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450240:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788536067.462352:0:18706:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788536067.462372:0:18706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788536067.462375:0:18706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788536067.462376:0:18706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536067.462377:0:18706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536067.462379:0:18706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536067.462380:0:18706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536067.462381:0:18706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536067.462383:0:18706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536067.462384:0:18706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788536067.462406:0:18706:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9004878ed800 from lustre-OST0000 10000000:01000000:0.0:1788536067.462440:0:18706:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788536067.462444:0:18706:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788536067.462452:0:18706:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90059fa94d40 local copy 00010000:00010000:0.0:1788536067.462464:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536067.462569:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536067.462672:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.462708:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536067.465054:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569450368 00000100:00100000:1.0:1788536067.465068:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569450368 00000100:00100000:1.0:1788536067.465133:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788536067.465177:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+18:18706:x1875415569450368:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536067.465307:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+18:18706:x1875415569450368:12345-0@lo:501:mount.lustre.0 Request processed in 165us (2634us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788536067.465315:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788536067.465463:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450368:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788536067.465485:0:18706:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788536067.465511:0:18706:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788536067.465519:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536067.465530:0:18706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536067.465557:0:18706:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9004878ed800 10000000:01000000:0.0:1788536067.465562:0:18706:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788536067.465567:0:18706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788536067.465576:0:18706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788536067.465581:0:18706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788536067.465584:0:18706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788536067.465612:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838000/0xe79af2f39bbdd7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536067.465620:0:18706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488838000/0xe79af2f39bbdd7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536067.465627:0:18706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488838000/0xe79af2f39bbdd7ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536067.465644:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788536067.465677:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.465711:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788536067.465767:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569450496 00000100:00100000:3.0:1788536067.465773:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569450496 00000100:00100000:3.0:1788536067.465808:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788536067.465816:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+18:18706:x1875415569450496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536067.465824:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536067.465845:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580031800/0xe79af2f39bbdd7b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd7ac expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.465881:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580031800/0xe79af2f39bbdd7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd7ac expref: 19 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.465893:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580031800/0xe79af2f39bbdd7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd7ac expref: 19 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.465902:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580031800, rc 0) 00000100:00100000:3.0:1788536067.465950:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569450496:12345-0@lo:101:mount.lustre.0 Request processed in 126us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536067.465962:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788536067.466122:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536067.466136:0:18706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488838000/0xe79af2f39bbdd7ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd7b3 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536067.466161:0:18706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488838000/0xe79af2f39bbdd7ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd7b3 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788536067.469232:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788536067.470025:0:18706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788536067.477592:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788536067.477652:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788536067.477669:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788536067.477685:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788536067.477699:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788536067.477713:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788536067.477757:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788536067.477763:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788536067.480859:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536067.481094:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.481227:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef540 going to sleep for 11 seconds 00000100:00100000:3.0:1788536067.481580:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569450624 00000100:00100000:3.0:1788536067.481589:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569450624 00000100:00100000:3.0:1788536067.481690:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788536067.481701:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569450624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536067.481910:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569450624:12345-0@lo:501:mount.lustre.0 Request processed in 211us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536067.481919:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788536067.482006:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536067.482055:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536067.482099:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.483268:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef540 going to sleep for 11 seconds 00000100:00100000:2.0:1788536067.483381:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569450752 00000100:00100000:2.0:1788536067.483388:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569450752 00000100:00100000:2.0:1788536067.483425:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788536067.483433:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569450752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536067.484217:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569450752:12345-0@lo:503:mount.lustre.0 Request processed in 782us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536067.484227:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788536067.484476:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788536067.485411:0:18706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788536067.485613:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536067.485685:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.485727:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788536067.485795:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569450880 00000100:00100000:3.0:1788536067.485803:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569450880 00000100:00100000:3.0:1788536067.485859:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788536067.485868:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569450880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536067.486531:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569450880:12345-0@lo:502:mount.lustre.0 Request processed in 662us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536067.486540:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788536067.486642:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569450880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788536067.486855:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788536067.486898:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788536067.486914:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788536067.486928:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788536067.486942:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788536067.486978:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788536067.486993:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788536067.487007:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788536067.487040:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788536067.487055:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788536067.487066:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788536067.487077:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788536067.487115:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536067.487197:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.487223:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788536067.487454:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569451008 00000100:00100000:3.0:1788536067.487460:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569451008 00000100:00100000:3.0:1788536067.487488:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788536067.487495:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569451008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536067.487582:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569451008:12345-0@lo:502:mount.lustre.0 Request processed in 86us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536067.487588:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788536067.488053:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788536067.488107:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788536067.488115:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788536067.489997:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788536067.490009:0:18723:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788536067.490015:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536067.490017:0:18723:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788536067.490030:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788536067.490051:0:18723:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff900485ee8000) 00000020:00000080:3.0:1788536067.490074:0:18723:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788536067.490081:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788536067.490177:0:18723:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9004878ed800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788536067.490187:0:18723:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788536067.490193:0:18723:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe79af2f39bbdd7c1 00010000:00010000:3.0:1788536067.494934:0:18723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788536067.495709:0:18723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788536067.499604:0:18723:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788536067.500793:0:18723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788536067.500804:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536067.500810:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536067.500811:0:18723:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788536067.500814:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788536067.500817:0:18723:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788536067.500818:0:18723:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788536067.500820:0:18723:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788536067.500821:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788536067.500825:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536067.500826:0:18723:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788536067.500842:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536067.500846:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536067.500848:0:18723:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788536067.500851:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788536067.500852:0:18723:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788536067.500855:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536067.500857:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536067.500858:0:18723:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788536067.500861:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536067.500863:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536067.500864:0:18723:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788536067.500867:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788536067.500898:0:18723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536067.500908:0:18723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536067.500909:0:18723:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788536067.500913:0:18723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788536067.501192:0:18706:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788536067.501219:0:18706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788536067.501235:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838000/0xe79af2f39bbdd7ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd7b3 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.501247:0:18706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488838000/0xe79af2f39bbdd7ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd7b3 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536067.501264:0:18706:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9004878ed800 from 1 10000000:01000000:1.0:1788536067.501267:0:18706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788536067.501300:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.501308:0:18706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.501318:0:18706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536067.501340:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536067.501404:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.501734:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058298bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788536067.502267:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569451136 00000100:00100000:3.0:1788536067.502277:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569451136 00000100:00100000:3.0:1788536067.502327:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788536067.502337:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+19:18706:x1875415569451136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536067.502351:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536067.502365:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd7c8 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.502392:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd7c8 expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.502402:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd7c8 expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.502412:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580030200, rc 0) 00000100:00100000:3.0:1788536067.502461:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451136:12345-0@lo:101:mount.lustre.0 Request processed in 125us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536067.502468:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788536067.503092:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536067.503110:0:18706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.503120:0:18706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788536067.510555:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788536067.510890:0:18706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788536067.511283:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788536067.511310:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788536067.511330:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788536067.511335:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788536067.511408:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536067.511491:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536067.511528:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788536067.511624:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569451264 00000100:00100000:1.0:1788536067.511637:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569451264 00000100:00100000:1.0:1788536067.511678:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788536067.511686:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536067.511784:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451264:12345-0@lo:501:mount.lustre.0 Request processed in 98us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.511791:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788536067.512906:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536067.513133:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451392:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788536067.513262:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536067.513295:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058a291a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788536067.513471:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569451392 00000100:00100000:1.0:1788536067.513477:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569451392 00000100:00100000:1.0:1788536067.513519:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788536067.513527:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536067.513623:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451392:12345-0@lo:503:mount.lustre.0 Request processed in 97us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.513631:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788536067.514236:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788536067.514637:0:18706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788536067.514710:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb04a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536067.514755:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536067.514781:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e5dd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788536067.514849:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569451520 00000100:00100000:1.0:1788536067.514854:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569451520 00000100:00100000:1.0:1788536067.514897:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788536067.514904:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536067.515003:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451520:12345-0@lo:502:mount.lustre.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.515010:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788536067.515178:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb04a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788536067.515332:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788536067.515355:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788536067.515365:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788536067.515375:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788536067.515386:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788536067.515396:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788536067.515406:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788536067.515416:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788536067.515426:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788536067.515438:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788536067.515452:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788536067.515476:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536067.515513:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.515535:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536067.515847:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569451648 00000100:00100000:1.0:1788536067.515852:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569451648 00000100:00100000:1.0:1788536067.515898:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788536067.515905:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536067.516275:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451648:12345-0@lo:502:mount.lustre.0 Request processed in 370us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.516292:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788536067.516397:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788536067.516456:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788536067.516466:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788536067.519757:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788536067.519771:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536067.519773:0:18728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788536067.519781:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9004878ed800 00000020:00000080:0.0:1788536067.519790:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788536067.519799:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788536067.519802:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536067.519804:0:18728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788536067.519806:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788536067.519808:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536067.519810:0:18728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788536067.519813:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9004878ed800 00000020:00000080:0.0:1788536067.519815:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788536067.520086:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788536067.520091:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536067.520093:0:18728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788536067.520095:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788536067.520098:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536067.520100:0:18728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788536067.520103:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9004878ed800 00000020:00000080:0.0:1788536067.520105:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788536067.520125:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788536067.520128:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536067.520129:0:18728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788536067.520131:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788536067.520134:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536067.520135:0:18728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788536067.520138:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9004878ed800 00000020:00000080:0.0:1788536067.520140:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788536067.520185:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788536067.520188:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788536067.520189:0:18728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788536067.520192:0:18728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788536067.522264:0:18706:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788536067.522303:0:18706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536067.522321:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.522333:0:18706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536067.522397:0:18706:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788536067.522400:0:18706:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9004878ed800 10000000:01000000:1.0:1788536067.522404:0:18706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9004878ed800 10000000:01000000:1.0:1788536067.522407:0:18706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788536067.522413:0:18706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9004878ed800 from 1 10000000:01000000:1.0:1788536067.522416:0:18706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788536067.522451:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620ec00/0xe79af2f39bbdd7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.522460:0:18706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620ec00/0xe79af2f39bbdd7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.522471:0:18706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620ec00/0xe79af2f39bbdd7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536067.522495:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536067.522556:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.522591:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462900 going to sleep for 11 seconds 00000100:00100000:0.0:1788536067.523646:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569451776 00000100:00100000:0.0:1788536067.523657:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569451776 00000100:00100000:0.0:1788536067.523701:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788536067.523711:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+20:18706:x1875415569451776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536067.523732:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536067.523747:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488838800/0xe79af2f39bbdd7dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd7d6 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536067.523773:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488838800/0xe79af2f39bbdd7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd7d6 expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536067.523784:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488838800/0xe79af2f39bbdd7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd7d6 expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536067.523793:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838800, rc 0) 00000100:00100000:0.0:1788536067.523866:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569451776:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.523873:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788536067.528881:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536067.528911:0:18706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620ec00/0xe79af2f39bbdd7d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd7dd expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536067.528924:0:18706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620ec00/0xe79af2f39bbdd7d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd7dd expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536067.539511:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788536067.539806:0:18706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536067.540055:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788536067.540079:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788536067.540093:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788536067.540107:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788536067.540120:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788536067.540131:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788536067.540172:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788536067.540189:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788536067.540203:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788536067.540215:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788536067.540228:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788536067.540239:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788536067.540250:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788536067.540261:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788536067.540286:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788536067.540300:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788536067.540312:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788536067.540322:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788536067.540333:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788536067.540343:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788536067.540354:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788536067.540365:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788536067.540378:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788536067.540389:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788536067.540401:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788536067.540413:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788536067.540424:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788536067.540436:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788536067.540447:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788536067.540460:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788536067.540488:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788536067.540503:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788536067.540518:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788536067.540543:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788536067.540558:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788536067.540572:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788536067.540586:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788536067.540606:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788536067.540611:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788536067.540697:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536067.540764:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.540809:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462600 going to sleep for 11 seconds 00000100:00100000:2.0:1788536067.551865:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569451904 00000100:00100000:2.0:1788536067.551878:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569451904 00000100:00100000:2.0:1788536067.551949:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788536067.551958:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569451904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788536067.552163:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569451904:12345-0@lo:501:mount.lustre.0 Request processed in 187us (11380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536067.552172:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788536067.559425:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569451904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536067.559495:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569452032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536067.559566:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.559613:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462600 going to sleep for 11 seconds 00000100:00100000:2.0:1788536067.560031:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569452032 00000100:00100000:2.0:1788536067.560038:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569452032 00000100:00100000:2.0:1788536067.560081:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788536067.560089:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569452032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788536067.560209:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569452032:12345-0@lo:503:mount.lustre.0 Request processed in 120us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536067.560216:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788536067.564305:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569452032:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788536067.564766:0:18706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536067.564863:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569452160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536067.564932:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.566225:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462600 going to sleep for 11 seconds 00000100:00100000:0.0:1788536067.575516:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569452160 00000100:00100000:0.0:1788536067.575532:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569452160 00000100:00100000:0.0:1788536067.575587:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788536067.575597:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569452160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536067.575767:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569452160:12345-0@lo:502:mount.lustre.0 Request processed in 171us (10835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.575776:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788536067.578214:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569452160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536067.578471:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788536067.578503:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788536067.578518:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788536067.578531:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788536067.578543:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788536067.578573:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788536067.578589:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788536067.578604:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788536067.578629:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788536067.578644:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788536067.578658:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788536067.578668:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788536067.578679:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788536067.578697:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788536067.578712:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788536067.578726:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788536067.578741:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788536067.578755:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788536067.578766:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788536067.578778:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788536067.578789:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788536067.578812:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788536067.578826:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788536067.578857:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788536067.578870:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788536067.579279:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788536067.579302:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788536067.579316:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788536067.579329:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788536067.579342:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788536067.579357:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788536067.579371:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788536067.579385:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788536067.579400:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788536067.579416:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788536067.579429:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788536067.579442:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788536067.579469:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788536067.579484:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788536067.579497:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788536067.579511:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788536067.579538:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788536067.579551:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788536067.579565:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788536067.579582:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788536067.579593:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788536067.579605:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788536067.579619:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788536067.579674:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569452288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536067.579747:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.579797:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462600 going to sleep for 11 seconds 00000100:00100000:2.0:1788536067.579824:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569452288 00000100:00100000:2.0:1788536067.579843:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569452288 00000100:00100000:2.0:1788536067.579891:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788536067.579901:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569452288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536067.580018:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569452288:12345-0@lo:502:mount.lustre.0 Request processed in 118us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536067.580026:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788536067.580114:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569452288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536067.580289:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788536067.580310:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788536067.580334:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569452416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536067.580409:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.580439:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462600 going to sleep for 11 seconds 00000100:00100000:2.0:1788536067.580574:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569452416 00000100:00100000:2.0:1788536067.580578:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569452416 00000100:00100000:2.0:1788536067.580606:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788536067.580611:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569452416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536067.580669:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569452416:12345-0@lo:502:mount.lustre.0 Request processed in 57us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536067.580677:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788536067.580696:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569452416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536067.580732:0:18706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788536067.580740:0:18706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788536067.583418:0:18733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788536067.583436:0:18733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff900485eeb380) 00000020:00000080:3.0:1788536067.583461:0:18733:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788536067.583561:0:18733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9004878ed800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788536067.583565:0:18733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9004878ed800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788536067.583568:0:18733:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9004878ed800 3 00010000:00080000:3.0:1788536067.583601:0:18733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff900488ac2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1788536067.587501:0:18733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788536067.587690:0:18733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788536067.587731:0:18733:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788536067.587744:0:18733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe79af2f39bbdd7eb 00000100:00080000:3.0:1788536067.587753:0:18733:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788536067.587760:0:18733:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff900488ac2000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536067.587793:0:18733:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9004888de680 x1875415569452544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788536067.587822:0:18733:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788536067.587882:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3659:1875415569452544:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788536067.587958:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.588015:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569452544 00000100:00100000:0.0:1788536067.588022:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569452544 00000100:00100000:0.0:1788536067.588052:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788536067.588058:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1875415569452544:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788536067.588088:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1788536067.588115:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe79af2f39bbdd7f2 00000004:00100000:0.0:1788536067.588128:0:17204:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788536067.588171:0:17204:0:(import.c:65:import_set_state_nolock()) ffff900485ed0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788536067.588214:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875415569452544:12345-0@lo:38:llog_process_th.0 Request processed in 155us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.588221:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788536067.588259:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9004888de680 x1875415569452544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788536077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536067.588268:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788536067.588275:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788536067.588280:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788536067.588283:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788536067.588285:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900488ac2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788536067.588290:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3659:1875415569452544:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788536067.589089:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536067.589094:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788536067.589096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536067.589099:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788536067.589124:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536067.589127:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788536067.589130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536067.589133:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788536067.589189:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569452672:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.589227:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.589253:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536067.589258:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569453056:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.589283:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.589309:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569452800:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.589329:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.589344:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788536067.589348:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569452928:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.589368:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.589398:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569452672 00000100:00100000:0.0:1788536067.589403:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569452672 00000100:00100000:0.0:1788536067.589427:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569452928 00000100:00100000:0.0:1788536067.589429:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569452928 00000100:00100000:0.0:1788536067.589442:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788536067.589449:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569452672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.589484:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569452672:12345-0@lo:400:kworker.0 Request processed in 36us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.589489:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788536067.589502:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788536067.589507:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569452928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.589535:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569452928:12345-0@lo:400:kworker.0 Request processed in 28us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.589541:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788536067.589559:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569453056 00000100:00100000:0.0:1788536067.589563:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569453056 00000100:00100000:0.0:1788536067.589590:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569452800 00000100:00100000:0.0:1788536067.589593:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569452800 00000100:00100000:0.0:1788536067.589605:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788536067.589610:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569453056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.589651:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569453056:12345-0@lo:400:kworker.0 Request processed in 39us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.589657:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788536067.589668:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788536067.589674:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569452800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.589697:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569452800:12345-0@lo:400:kworker.0 Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.589702:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788536067.589738:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569452928:0@lo:400:kworker.0 00010000:00080000:0.0:1788536067.589750:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff900481cfc380 x1875415569452800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536067.589760:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569452800:0@lo:400:kworker.0 00010000:00080000:0.0:1788536067.589785:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff900481cfd180 x1875415569453056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536067.589794:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569453056:0@lo:400:kworker.0 00000100:00100000:0.0:1788536067.589804:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569452672:0@lo:400:kworker.0 00000020:01000004:2.0:1788536067.590557:0:18733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788536067.590578:0:18733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff900488acb380) 00000020:00000080:2.0:1788536067.590599:0:18733:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788536067.590689:0:18733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9004878ed800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788536067.590693:0:18733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9004878ed800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788536067.590696:0:18733:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9004878ed800 3 00010000:00080000:2.0:1788536067.590722:0:18733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff900488af6800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1788536067.595124:0:18733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788536067.595333:0:18733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788536067.595379:0:18733:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788536067.595390:0:18733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe79af2f39bbdd800 00000100:00080000:0.0:1788536067.595399:0:18733:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788536067.595409:0:18733:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff900488af6800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1788536067.595442:0:18733:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059faf1880 x1875415569453184/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788536067.595478:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3659:1875415569453184:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788536067.595548:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.595998:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569453184 00000100:00100000:0.0:1788536067.596006:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569453184 00000100:00100000:0.0:1788536067.596037:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788536067.596044:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1875415569453184:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788536067.596068:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1788536067.596097:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe79af2f39bbdd807 00000004:00100000:0.0:1788536067.596111:0:17205:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788536067.596138:0:17205:0:(import.c:65:import_set_state_nolock()) ffff900485ed4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788536067.596209:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875415569453184:12345-0@lo:38:llog_process_th.0 Request processed in 164us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.596217:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788536067.596255:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90059faf1880 x1875415569453184/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788536077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536067.596264:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788536067.596270:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788536067.596276:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788536067.596281:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788536067.596283:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900488af6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788536067.596288:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3659:1875415569453184:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788536067.596308:0:18733:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788536067.596338:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536067.596343:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788536067.596345:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536067.596348:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788536067.596352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536067.596355:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788536067.596357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788536067.596360:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788536067.599763:0:18733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788536067.599924:0:18706:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788536067.599967:0:18706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788536067.599991:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620ec00/0xe79af2f39bbdd7d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd7dd expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536067.600003:0:18706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620ec00/0xe79af2f39bbdd7d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd7dd expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788536067.600061:0:18706:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788536067.600064:0:18706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788536067.600065:0:18706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536067.600066:0:18706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536067.600068:0:18706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536067.600069:0:18706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536067.600071:0:18706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536067.600073:0:18706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536067.600074:0:18706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788536067.600078:0:18706:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788536067.600081:0:18706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788536067.600082:0:18706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788536067.600083:0:18706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536067.600089:0:18706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536067.600090:0:18706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536067.600091:0:18706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536067.600092:0:18706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536067.600093:0:18706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536067.600094:0:18706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788536067.600119:0:18706:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788536067.600141:0:18706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569453312:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788536067.600238:0:18706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.600273:0:18706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788536067.600293:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569453312 00000100:00100000:0.0:1788536067.600299:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569453312 00000100:00100000:0.0:1788536067.600340:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788536067.600349:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569453312:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788536067.600375:0:17198:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788536067.600387:0:17198:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788536067.609033:0:17198:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788536067.609057:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788536067.609102:0:17220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788536067.609107:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788536067.609129:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609161:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd751 expref: 21 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609170:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd75f expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609195:0:17220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609233:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd75f expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609246:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd75f expref: 21 pid: 17198 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536067.609273:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569453440:0@lo:104: 00000100:00100000:1.0:1788536067.609333:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536067.609354:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:18706:x1875415569453312:12345-0@lo:253:mount.lustre.0 Request processed in 9004us (9115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536067.609363:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1788536067.609371:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd751 expref: 21 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609379:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd751 expref: 20 pid: 17196 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536067.609386:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569453568:0@lo:104: 00000100:00100000:1.0:1788536067.609407:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.609422:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462600 going to sleep for 11 seconds 00000100:00100000:0.0:1788536067.609422:0:18706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:18706:1875415569453312:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788536067.609432:0:18706:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788536067.609435:0:18706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788536067.609437:0:18706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788536067.609438:0:18706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536067.609439:0:18706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536067.609441:0:18706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536067.609442:0:18706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:1.0:1788536067.609443:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000020:01000004:0.0:1788536067.609443:0:18706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536067.609445:0:18706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536067.609446:0:18706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788536067.609455:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569453440 00000100:00100000:1.0:1788536067.609459:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569453440 00000020:02000000:0.0:1788536067.609460:0:18706:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788536067.609484:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569453568 00000100:00100000:1.0:1788536067.609486:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569453568 00000100:00100000:1.0:1788536067.609497:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788536067.609504:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+4:17220:x1875415569453440:12345-0@lo:104: 00010000:00010000:1.0:1788536067.609516:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609563:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788536067.609569:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+4:17220:x1875415569453440:12345-0@lo:104: Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.609575:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788536067.609589:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536067.609595:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+3:17220:x1875415569453568:12345-0@lo:104: 00010000:00010000:1.0:1788536067.609603:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609632:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788536067.609637:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+3:17220:x1875415569453568:12345-0@lo:104: Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.609643:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536067.609687:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569453440:0@lo:104: 00000100:00100000:1.0:1788536067.609695:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569453568:0@lo:104: 00010000:00010000:1.0:1788536067.609708:0:17220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609724:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788536067.609730:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609737:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f800 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788536067.609741:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609749:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788536067.609777:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536067.609783:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788536067.609810:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609817:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788536067.609848:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609856:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059632f800/0xe79af2f39bbdd75f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd766 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609870:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536067.609873:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609889:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f400 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:1.0:1788536067.609892:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609899:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788536067.609905:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536067.609911:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788536067.609931:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609937:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788536067.609952:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609959:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059632f400/0xe79af2f39bbdd751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd758 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.609972:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536067.609974:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536067.609976:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536067.609982:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536067.609992:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569453696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788536067.610018:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.610064:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569453824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788536067.610086:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536067.610118:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569453696 00000100:00100000:1.0:1788536067.610121:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569453696 00010000:00010000:1.0:1788536067.610137:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd75f expref: 21 pid: 17198 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536067.610176:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569453824 00000100:00100000:1.0:1788536067.610180:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569453824 00010000:00010000:1.0:1788536067.610190:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd751 expref: 22 pid: 17196 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536067.610202:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788536067.610208:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25821a76-2177-4c11-bd6b-eb660028a815+22:3663:x1875415569453696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536067.610227:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536067.610233:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd75f expref: 22 pid: 17198 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610243:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd75f expref: 22 pid: 17198 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610256:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632ee00/0xe79af2f39bbdd766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd75f expref: 22 pid: 17198 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610268:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788536067.610295:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25821a76-2177-4c11-bd6b-eb660028a815+21:3663:x1875415569453696:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.610301:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788536067.610314:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536067.610321:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900584bae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25821a76-2177-4c11-bd6b-eb660028a815+20:3660:x1875415569453824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536067.610328:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536067.610332:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd751 expref: 20 pid: 17196 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610341:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd751 expref: 20 pid: 17196 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610351:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632f200/0xe79af2f39bbdd758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd751 expref: 20 pid: 17196 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610363:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610371:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788536067.610389:0:17190:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003290456s 00010000:00010000:1.0:1788536067.610394:0:17190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610401:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610408:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610415:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610421:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536067.610425:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610433:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610445:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610454:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788536067.610481:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900584bae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25821a76-2177-4c11-bd6b-eb660028a815+19:3660:x1875415569453824:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536067.610487:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536067.610538:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569453696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536067.610555:0:17220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610568:0:17220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536067.610574:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059620f200/0xe79af2f39bbdd80e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536067.610600:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569453824:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788536067.644122:0:18706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788536067.667932:0:18706:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788536067.668117:0:18706:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788536067.668194:0:18706:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788536067.668248:0:18706:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788536067.668269:0:18706:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788536067.668307:0:18706:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788536067.672604:0:18706:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788536067.675311:0:18706:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788536068.204481:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788536068.727466:0:18786:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788536068.728105:0:18786:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788536069.164596:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788536069.164604:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff900590d0d800 from 9 10000000:01000000:1.0:1788536069.164608:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788536069.164650:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536069.164663:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536069.164731:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536069.164754:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569453952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788536069.164811:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536069.165587:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462180 going to sleep for 11 seconds 00000100:00100000:2.0:1788536069.177056:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569453952 00000100:00100000:2.0:1788536069.177071:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569453952 00000100:00100000:3.0:1788536069.179104:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788536069.179117:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+19:17202:x1875415569453952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788536069.179136:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536069.179171:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd815 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536069.179197:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd815 expref: 20 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536069.179209:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd815 expref: 20 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536069.179219:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580031a00, rc 0) 00000100:00100000:3.0:1788536069.179294:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+20:17202:x1875415569453952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (14482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536069.179301:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788536069.183856:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569453952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536069.183903:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536069.183916:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536069.184138:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569454080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788536069.184237:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536069.184498:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462180 going to sleep for 11 seconds 00000100:00100000:0.0:1788536069.184630:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569454080 00000100:00100000:0.0:1788536069.184638:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569454080 00000100:00100000:0.0:1788536069.184787:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788536069.184798:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+20:17202:x1875415569454080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788536069.184816:0:17198:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788536069.184842:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788536069.184844:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788536069.185236:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+20:17202:x1875415569454080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 439us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536069.185259:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788536069.185690:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569454080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788536069.185749:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788536069.185757:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536069.185767:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536069.185776:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788536069.185779:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff900586554800 from 9 10000000:01000000:1.0:1788536069.185781:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788536069.185806:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536069.185814:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536069.185840:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536069.185861:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569454208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788536069.186135:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536069.186206:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462180 going to sleep for 11 seconds 00000100:00100000:0.0:1788536069.186551:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569454208 00000100:00100000:0.0:1788536069.186557:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569454208 00000100:00100000:0.0:1788536069.186633:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788536069.186642:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+20:17202:x1875415569454208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536069.186652:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536069.186665:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd823 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536069.186687:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd823 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536069.186707:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd823 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536069.186715:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839200, rc 0) 00000100:00100000:0.0:1788536069.186754:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+21:17202:x1875415569454208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536069.186769:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788536069.186839:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569454208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536069.186850:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536069.186858:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536069.186917:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569454336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788536069.186955:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536069.188169:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e462180 going to sleep for 11 seconds 00000100:00100000:3.0:1788536069.188562:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569454336 00000100:00100000:3.0:1788536069.188569:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569454336 00000100:00100000:3.0:1788536069.188603:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788536069.188610:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:17202:x1875415569454336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788536069.188625:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788536069.188643:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788536069.188647:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788536069.189038:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:17202:x1875415569454336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 427us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536069.189046:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788536069.193551:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569454336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788536069.193638:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788536069.193648:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536069.193660:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536069.231025:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536070.255203:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788536070.518173:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788536071.297339:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536071.601360:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569454464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788536071.601427:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536071.601483:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569454464 00000100:00100000:1.0:1788536071.601490:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569454464 00000100:00100000:1.0:1788536071.601549:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788536071.601556:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569454464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788536071.601585:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788536071.601627:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569454464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536071.601634:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788536071.603506:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569454464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788536072.124180:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536072.124207:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569454592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788536072.124280:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536072.124642:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569454592 00000100:00100000:3.0:1788536072.124650:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569454592 00000100:00100000:3.0:1788536072.124708:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788536072.124720:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569454592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788536072.124757:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788536072.124823:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569454592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536072.124831:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788536072.124958:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569454592:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788536072.301285:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788536072.625782:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536072.625789:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536072.625791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536072.625805:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536072.625822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536072.625825:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788536072.625827:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536072.625830:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788536072.625882:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569454848:0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.626231:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536072.626276:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569455360:0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.626305:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536072.626330:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788536072.626336:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569454976:0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.626356:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536072.626372:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569455488:0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.626410:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536072.626447:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569454848 00000100:00100000:1.0:1788536072.626454:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569454848 00000100:00100000:1.0:1788536072.626491:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788536072.626498:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569454848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.626544:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569454848:12345-0@lo:400:kworker.0 Request processed in 47us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536072.626551:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788536072.626574:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569455360 00000100:00100000:1.0:1788536072.626577:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569455360 00000100:00100000:1.0:1788536072.626602:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569454976 00000100:00100000:1.0:1788536072.626605:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569454976 00000100:00100000:1.0:1788536072.626614:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569455488 00000100:00100000:3.0:1788536072.626717:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569455104:0@lo:400:kworker.0 00000100:00100000:3.0:1788536072.626749:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536072.626773:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788536072.626779:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569454720:0@lo:400:kworker.0 00000100:00100000:3.0:1788536072.626814:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536072.626836:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569455232:0@lo:400:kworker.0 00000100:00100000:3.0:1788536072.626856:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536072.626888:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569455104 00000100:00100000:3.0:1788536072.626892:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569455104 00000100:00100000:3.0:1788536072.626927:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788536072.626941:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569455104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536072.626974:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569455104:12345-0@lo:400:kworker.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536072.626980:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788536072.627272:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788536072.627290:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569454720 00000100:00100000:3.0:1788536072.627294:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569454720 00000100:00100000:3.0:1788536072.627318:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788536072.627325:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:3662:x1875415569454720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536072.627362:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:3662:x1875415569454720:12345-0@lo:400:kworker.0 Request processed in 38us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536072.627368:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788536072.627415:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569454720:0@lo:400:kworker.0 00000100:00100000:3.0:1788536072.627427:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569455104:0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.628489:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569455488 00000100:00100000:1.0:1788536072.628526:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569455232 00000100:00100000:1.0:1788536072.628529:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569455232 00000100:00100000:1.0:1788536072.628543:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788536072.628549:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569455360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.628602:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569455360:12345-0@lo:400:kworker.0 Request processed in 53us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536072.628608:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788536072.629701:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788536072.629772:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788536072.629784:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569454976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.629848:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569454976:12345-0@lo:400:kworker.0 Request processed in 68us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536072.629854:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788536072.631240:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788536072.631252:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569455488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.631311:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569455488:12345-0@lo:400:kworker.0 Request processed in 62us (4900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536072.631318:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788536072.631331:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788536072.631337:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569455232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.631377:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569455232:12345-0@lo:400:kworker.0 Request processed in 40us (4520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536072.631382:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788536072.631432:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90048891ed80 x1875415569454976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536072.631446:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569454976:0@lo:400:kworker.0 00010000:00080000:1.0:1788536072.631456:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90048891d880 x1875415569455488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536072.631464:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569455488:0@lo:400:kworker.0 00000100:00100000:1.0:1788536072.631475:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569454848:0@lo:400:kworker.0 00010000:00080000:1.0:1788536072.631484:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90048891d500 x1875415569455360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536072.631492:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569455360:0@lo:400:kworker.0 00010000:00080000:3.0:1788536072.631757:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90048891ca80 x1875415569455232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536072.631767:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569455232:0@lo:400:kworker.0 00010000:00010000:3.0:1788536073.326422:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788536073.840591:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788536074.350356:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788536075.261455:0:19076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788536075.378507:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788536076.255692:0:19128:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788536076.263333:0:19128:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788536076.401728:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536076.716585:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536076.716607:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569455616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788536076.716670:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536076.717367:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569455616 00000100:00100000:1.0:1788536076.717377:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569455616 00000100:00100000:1.0:1788536076.717433:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788536076.717454:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569455616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788536076.717487:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788536076.717536:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569455616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536076.717543:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788536076.717636:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569455616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788536076.845271:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536061/real 1788536061] req@ffff9004888ddf80 x1875415569448832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536076 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536076.845308:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9004888ddf80 x1875415569448832/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536076 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536076.845320:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536061/real 1788536061] req@ffff9004888dd880 x1875415569448960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536076 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536076.845331:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9004888dd880 x1875415569448960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536076 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788536076.845351:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005842b7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788536076.845378:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788536076.845382:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569448832:0@lo:8:kworker.0 00000100:00080000:2.0:1788536076.845388:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788536076.845393:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788536076.845397:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569448960:0@lo:8:kworker.0 00000100:00080000:3.0:1788536076.845538:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536076.845543:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536076.845546:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536076.845549:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536076.845559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536076.845562:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788536076.845565:0:37:0:(import.c:65:import_set_state_nolock()) ffff9005842b7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536076.845570:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:3.0:1788536076.845575:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788536076.845582:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9005842b7000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536076.845600:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9004888ded80 x1875415569456128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788536076.845619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536076.845622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788536076.845623:0:37:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536076.845627:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:3.0:1788536076.845629:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788536076.845633:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff900589926000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536076.845643:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9004888dd880 x1875415569456256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788536076.845682:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569455872:0@lo:400:kworker.0 00000100:00100000:3.0:1788536076.845741:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536076.845796:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569456640:0@lo:400:kworker.0 00000100:00100000:3.0:1788536076.845824:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536076.845842:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788536076.845848:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569456000:0@lo:400:kworker.0 00000100:00100000:3.0:1788536076.845866:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536076.845910:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569455872 00000100:00100000:3.0:1788536076.845917:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569455872 00000100:00100000:3.0:1788536076.845965:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788536076.845974:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569455872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536076.846026:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569455872:12345-0@lo:400:kworker.0 Request processed in 52us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536076.846034:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788536076.846071:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569456640 00000100:00100000:3.0:1788536076.846075:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569456640 00000100:00100000:3.0:1788536076.846107:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569456000 00000100:00100000:3.0:1788536076.846116:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569456000 00000100:00100000:3.0:1788536076.846134:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788536076.846140:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569456640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536076.846196:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569456640:12345-0@lo:400:kworker.0 Request processed in 57us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536076.846202:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788536076.846214:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788536076.846220:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569456000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536076.846246:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569456000:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536076.846251:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788536076.846270:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788536076.846286:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569456128:0@lo:8:kworker.0 00000100:00100000:3.0:1788536076.846313:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536076.846336:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569456256:0@lo:8:kworker.0 00000100:00100000:3.0:1788536076.846357:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536076.846391:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569456128 00000100:00100000:3.0:1788536076.846395:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569456128 00000100:00100000:3.0:1788536076.846410:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569456256 00000100:00100000:3.0:1788536076.846412:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569456256 00000100:00100000:3.0:1788536076.846421:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536076.846426:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3659:x1875415569456128:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788536076.846452:0:18711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1788536076.846477:0:18711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdd831 00002000:00100000:3.0:1788536076.846490:0:18711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff900488ac0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788536076.846495:0:18711:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788536076.846503:0:18711:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788536076.846672:0:18711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788536076.846693:0:18711:0:(import.c:65:import_set_state_nolock()) ffff900488ac3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788536076.846730:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1875415569456128:12345-0@lo:8:kworker.0 Request processed in 302us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536076.846736:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788536076.846748:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788536076.846752:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3659:x1875415569456256:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788536076.846774:0:18711:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788536076.848988:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569455744:0@lo:400:kworker.0 00000100:00100000:0.0:1788536076.849071:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536076.849114:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569456512:0@lo:400:kworker.0 00000100:00100000:0.0:1788536076.849141:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536076.849194:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788536076.849201:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569456384:0@lo:400:kworker.0 00000100:00100000:0.0:1788536076.849221:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536076.849250:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569455744 00000100:00100000:0.0:1788536076.849257:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569455744 00000100:00100000:0.0:1788536076.849297:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788536076.849306:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:3663:x1875415569455744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536076.849348:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:3663:x1875415569455744:12345-0@lo:400:kworker.0 Request processed in 43us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536076.849371:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788536076.849404:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569456512 00000100:00100000:0.0:1788536076.849407:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569456512 00000100:00100000:0.0:1788536076.849437:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569456384 00000100:00100000:0.0:1788536076.849440:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569456384 00000100:00100000:0.0:1788536076.849452:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788536076.849458:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569456512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536076.849487:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569456512:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536076.849493:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788536076.849503:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788536076.849508:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569456384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536076.849529:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569456384:12345-0@lo:400:kworker.0 Request processed in 21us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536076.849535:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788536076.849552:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788536076.849579:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9004888ddf80 x1875415569456384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536076.849594:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569456384:0@lo:400:kworker.0 00000100:00100000:0.0:1788536076.849603:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569455744:0@lo:400:kworker.0 00010000:00080000:0.0:1788536076.849612:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9004888dd180 x1875415569456512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536076.849621:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569456512:0@lo:400:kworker.0 00010000:00080000:2.0:1788536076.850223:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9004888de680 x1875415569456000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536076.850235:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569456000:0@lo:400:kworker.0 00000100:00100000:2.0:1788536076.850247:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569455872:0@lo:400:kworker.0 00010000:00080000:2.0:1788536076.850265:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900488873800 x1875415569456640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536076.850274:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569456640:0@lo:400:kworker.0 00010000:00080000:2.0:1788536076.852284:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9004888ded80 x1875415569456128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788536096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536076.852314:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788536076.852325:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788536076.852333:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788536076.852339:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788536076.852343:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9005842b7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788536076.852362:0:3659:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788536076.852367:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569456128:0@lo:8:kworker.0 00000004:00080000:2.0:1788536076.852398:0:17946:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788536076.852484:0:17946:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 535656336819ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788536076.852491:0:17946:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788536076.855271:0:17937:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000004:00080000:0.0:1788536076.855441:0:17947:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788536076.855476:0:17947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875415569456896:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788536076.855535:0:17947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536076.855561:0:17947:0:(client.c:2716:ptlrpc_set_wait()) set ffff900486b0d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788536076.855584:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788536076.855591:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788536076.855606:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569456768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788536076.855630:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536076.855669:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569456768 00000100:00100000:0.0:1788536076.855677:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569456768 00000100:00100000:0.0:1788536076.855721:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788536076.855731:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1875415569456768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788536076.855756:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788536076.855806:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1875415569456768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536076.855813:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788536076.855832:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788536076.855857:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059faf3b80 x1875415569456768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788536092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536076.855887:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569456768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788536076.860961:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569456896 00000100:00100000:2.0:1788536076.860974:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569456896 00000100:00100000:0.0:1788536076.861270:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788536076.861283:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17947:x1875415569456896:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1788536076.867904:0:19157:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788536076.867913:0:19157:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788536076.868011:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17947:x1875415569456896:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6727us (12471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536076.868021:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788536076.868203:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059faf3480 x1875415569456896/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788536092 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536076.868218:0:17947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875415569456896:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788536076.868232:0:17947:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788536076.868273:0:17947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb04000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875415569457024:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788536076.868308:0:17947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536076.868331:0:17947:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536076.868355:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569457024 00000100:00100000:2.0:1788536076.868361:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569457024 00000100:00100000:3.0:1788536076.874563:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3659:x1875415569456256:12345-0@lo:8:kworker.0 Request processed in 27800us (28195us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788536076.874579:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536076.874773:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788536076.874788:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17947:x1875415569457024:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788536076.874817:0:18712:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788536076.874860:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17947:x1875415569457024:12345-0@lo:5:osp-pre-0-1.0 Request processed in 79us (6551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536076.874890:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788536076.874933:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059fb04000 x1875415569457024/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788536092 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536076.874948:0:17947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb04000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875415569457024:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788536076.874962:0:17947:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788536076.875007:0:17947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb04000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875415569457152:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788536076.875038:0:17947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536076.875070:0:17947:0:(client.c:2716:ptlrpc_set_wait()) set ffff900487b3ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788536076.875084:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569457152 00000100:00100000:2.0:1788536076.875089:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569457152 00000100:00100000:2.0:1788536076.875115:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788536076.875121:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17947:x1875415569457152:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788536076.875404:0:18712:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00080000:0.0:1788536076.876192:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788536076.876199:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788536076.876203:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569456256:0@lo:8:kworker.0 00000001:00080000:3.0:1788536076.901559:0:18707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788536076.901578:0:18707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788536076.901781:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17947:x1875415569457152:12345-0@lo:5:osp-pre-0-1.0 Request processed in 26655us (26737us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788536076.901791:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788536076.901887:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059fb04000 x1875415569457152/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788536092 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536076.901900:0:17947:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788536076.901906:0:17947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb04000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875415569457152:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788536076.901923:0:17947:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788536076.901976:0:17947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17947:1875415569457280:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788536076.902010:0:17947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536076.902052:0:17947:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4563c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788536076.902225:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569457280 00000100:00100000:2.0:1788536076.902231:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569457280 00000100:00100000:2.0:1788536076.902272:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788536076.902281:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17947:x1875415569457280:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788536076.902327:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17947:x1875415569457280:12345-0@lo:900:osp-pre-0-1.0 Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536076.902334:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788536076.902489:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900488873480 x1875415569457280/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788536092 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536076.902500:0:17947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17947:1875415569457280:0@lo:900:osp-pre-0-1.0 00000020:00000004:2.0:1788536077.127018:0:19179:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788536077.127484:0:19179:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788536077.229479:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788536077.229500:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569457408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788536077.229566:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536077.229611:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569457408 00000100:00100000:3.0:1788536077.229619:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569457408 00000100:00100000:3.0:1788536077.229663:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788536077.229671:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569457408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788536077.229708:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788536077.229749:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569457408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536077.229756:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788536077.229814:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569457408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788536077.421405:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536078.454247:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536079.469029:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536080.492427:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788536080.750133:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788536081.517285:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536081.836299:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569457536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788536081.836372:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536081.836460:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569457536 00000100:00100000:0.0:1788536081.836469:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569457536 00000100:00100000:0.0:1788536081.836525:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788536081.836537:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569457536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788536081.836571:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788536081.837550:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569457536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1013us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536081.837561:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788536081.837642:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569457536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788536082.349051:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788536082.349077:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569457664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788536082.349167:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788536082.349309:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536082.349312:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536082.349315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536082.349318:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788536082.349332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536082.349336:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788536082.349340:0:36:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536082.349346:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 535 00000100:00080000:3.0:1788536082.349352:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788536082.349359:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff900589926000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536082.349384:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900488871880 x1875415569458304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788536082.350633:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569457920:0@lo:400:kworker.0 00000100:00100000:0.0:1788536082.350914:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536082.350996:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569458560:0@lo:400:kworker.0 00000100:00100000:0.0:1788536082.351023:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536082.351049:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788536082.351056:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569458048:0@lo:400:kworker.0 00000100:00100000:0.0:1788536082.351077:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536082.351093:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569458688:0@lo:400:kworker.0 00000100:00100000:0.0:1788536082.351112:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536082.351136:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569458304:0@lo:8:kworker.0 00000100:00100000:0.0:1788536082.351178:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536082.351217:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569458560 00000100:00100000:0.0:1788536082.351224:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569458560 00000100:00100000:0.0:1788536082.351270:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569458048 00000100:00100000:0.0:1788536082.351274:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569458048 00000100:00100000:0.0:1788536082.351285:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569458688 00000100:00100000:0.0:1788536082.351287:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569458688 00000100:00100000:0.0:1788536082.351304:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788536082.351311:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569458560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536082.351359:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569458560:12345-0@lo:400:kworker.0 Request processed in 48us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536082.351366:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788536082.351382:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788536082.351387:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569458048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536082.351411:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569458048:12345-0@lo:400:kworker.0 Request processed in 24us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536082.351416:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788536082.351427:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788536082.351433:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569458688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536082.351457:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569458688:12345-0@lo:400:kworker.0 Request processed in 24us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536082.351462:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788536082.351485:0:19157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569458304 00000100:00100000:0.0:1788536082.351489:0:19157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569458304 00000100:00100000:0.0:1788536082.351509:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788536082.351514:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3659:x1875415569458304:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788536082.351535:0:19157:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788536082.351754:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569457792:0@lo:400:kworker.0 00000100:00100000:1.0:1788536082.351855:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536082.351885:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569458432:0@lo:400:kworker.0 00000100:00100000:1.0:1788536082.351909:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536082.351927:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788536082.351934:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569458176:0@lo:400:kworker.0 00000100:00100000:1.0:1788536082.352644:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788536082.355846:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900488872a00 x1875415569458048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536082.355867:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569458048:0@lo:400:kworker.0 00010000:00080000:2.0:1788536082.355883:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900488870380 x1875415569458688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536082.355893:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569458688:0@lo:400:kworker.0 00010000:00080000:2.0:1788536082.355916:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900488870000 x1875415569458560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536082.355925:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569458560:0@lo:400:kworker.0 00000100:00080000:2.0:1788536082.356081:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788536082.356087:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788536082.356304:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569458816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788536082.356371:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536082.356693:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569457920 00000100:00100000:3.0:1788536082.356702:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569457920 00000100:00100000:1.0:1788536082.356744:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569457664 00000100:00100000:1.0:1788536082.356749:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569457664 00000100:00100000:3.0:1788536082.356759:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569458176 00000100:00100000:3.0:1788536082.356762:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569458176 00000100:00100000:3.0:1788536082.356773:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569458816 00000100:00100000:1.0:1788536082.356799:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788536082.356810:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569457664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788536082.356846:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788536082.356895:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569457664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (7727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536082.356917:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788536082.356957:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569457792 00000100:00100000:1.0:1788536082.356961:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569457792 00000100:00100000:1.0:1788536082.356994:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788536082.357001:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+21:3661:x1875415569457792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536082.357035:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+21:3661:x1875415569457792:12345-0@lo:400:kworker.0 Request processed in 35us (5180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536082.357042:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788536082.357071:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569458432 00000100:00100000:1.0:1788536082.357075:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569458432 00000100:00100000:1.0:1788536082.357103:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788536082.357110:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569458432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536082.357142:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569458432:12345-0@lo:400:kworker.0 Request processed in 32us (5232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536082.357170:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788536082.357189:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788536082.357197:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569457920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536082.357682:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569457920:12345-0@lo:400:kworker.0 Request processed in 484us (6767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536082.357689:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788536082.357706:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788536082.357713:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569458176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536082.357755:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569458176:12345-0@lo:400:kworker.0 Request processed in 43us (5113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536082.357761:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788536082.357766:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569458816 00000100:00080000:1.0:1788536082.357793:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788536082.357803:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788536082.357810:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569458816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788536082.357835:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788536082.357836:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569457920:0@lo:400:kworker.0 00000100:00100000:1.0:1788536082.357869:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569458176:0@lo:400:kworker.0 00000100:00100000:1.0:1788536082.357878:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569457792:0@lo:400:kworker.0 00010000:00080000:1.0:1788536082.357892:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900488872d80 x1875415569458432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536082.357900:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569458816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536082.357902:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569458432:0@lo:400:kworker.0 00000100:00100000:3.0:1788536082.357906:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788536082.357913:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90048891f480 x1875415569457664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788536098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536082.357927:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569457664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788536082.357966:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569458816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788536082.362095:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3659:x1875415569458304:12345-0@lo:8:kworker.0 Request processed in 10568us (10905us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788536082.362132:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788536082.363545:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788536082.363556:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788536082.363561:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569458304:0@lo:8:kworker.0 00010000:00010000:1.0:1788536082.540620:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788536083.055063:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788536083.570936:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788536084.294341:0:19524:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788536084.294345:0:19524:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788536084.294346:0:19524:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788536084.294471:0:19524:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff900488af2800 00000020:01000004:2.0:1788536084.294489:0:19524:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788536084.294506:0:19524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788536084.294521:0:19524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff900488ac99c0) 00000020:00000080:2.0:1788536084.294537:0:19524:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788536084.369450:0:19524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788536084.380234:0:19524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788536084.381407:0:19524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788536084.383039:0:19524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788536084.384220:0:19524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788536084.384521:0:19524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788536084.384912:0:19524:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788536084.396645:0:19524:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788536084.396893:0:19524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788536084.396908:0:19524:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788536084.396920:0:19524:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe79af2f39bbdd83f 00000020:01000004:3.0:1788536084.396927:0:19524:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788536084.396949:0:19524:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788536084.396952:0:19524:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788536084.396956:0:19524:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788536084.396985:0:19524:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788536084.397003:0:19524:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:3.0:1788536084.398217:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536064/real 1788536064] req@ffff90059fb7b480 x1875415569449344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536084.398243:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90059fb7b480 x1875415569449344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536084.398254:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788536064/real 1788536064] req@ffff90059fb79880 x1875415569449472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536084.398265:0:3659:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90059fb79880 x1875415569449472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788536084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788536084.398280:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059bfb2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788536084.398305:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788536084.398309:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569449344:0@lo:8:kworker.0 00000100:00080000:3.0:1788536084.398314:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059b60e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788536084.398320:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788536084.398322:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569449472:0@lo:8:kworker.0 00000100:00080000:1.0:1788536084.399025:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536084.399029:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788536084.399033:0:37:0:(import.c:65:import_set_state_nolock()) ffff90059bfb2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788536084.399039:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 522 00000100:00080000:1.0:1788536084.399045:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788536084.399053:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90059bfb2800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788536084.399074:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90048891c700 x1875415569459200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788536084.399091:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536084.399094:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788536084.399096:0:37:0:(import.c:65:import_set_state_nolock()) ffff90059b60e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788536084.399106:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 522 00000100:00080000:1.0:1788536084.399109:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788536084.399113:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90059b60e800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788536084.399125:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90048891c000 x1875415569459328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788536084.399191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788536084.399194:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788536084.399195:0:37:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788536084.399200:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 541 00000100:00080000:1.0:1788536084.399202:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788536084.399206:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff900589926000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1788536084.399217:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900487ad3b80 x1875415569459840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788536084.399256:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569459200:0@lo:8:kworker.0 00000100:00100000:1.0:1788536084.399329:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.399370:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569459328:0@lo:8:kworker.0 00000100:00100000:1.0:1788536084.399404:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.399422:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569459840:0@lo:8:kworker.0 00000100:00100000:1.0:1788536084.399445:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.399481:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569459200 00000100:00100000:1.0:1788536084.399488:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569459200 00000100:00100000:1.0:1788536084.399516:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569459328 00000100:00100000:1.0:1788536084.399519:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569459328 00000100:00100000:1.0:1788536084.399527:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569459840 00000100:00100000:1.0:1788536084.399529:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569459840 00000100:00100000:1.0:1788536084.399539:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536084.399553:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3659:x1875415569459200:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788536084.399579:0:18712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:1.0:1788536084.399631:0:18712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdd846 00002000:00100000:1.0:1788536084.399644:0:18712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90048695b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788536084.399648:0:18712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788536084.399651:0:18712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788536084.399752:0:18712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788536084.399775:0:18712:0:(import.c:65:import_set_state_nolock()) ffff90048695c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788536084.400174:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569458944:0@lo:400:kworker.0 00000100:00100000:3.0:1788536084.400247:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569459072:0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.400342:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569459584:0@lo:400:kworker.0 00000100:00100000:2.0:1788536084.404589:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536084.404659:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569459712:0@lo:400:kworker.0 00000100:00100000:3.0:1788536084.404884:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536084.404911:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569459968:0@lo:400:kworker.0 00000100:00100000:3.0:1788536084.409408:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.409408:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536084.409490:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788536084.409493:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569459968 00000100:00100000:3.0:1788536084.409504:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569459456:0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.409504:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569459968 00000100:00100000:0.0:1788536084.409562:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788536084.409568:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.409576:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569459968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536084.409593:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569460096:0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.409632:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875415569459968:12345-0@lo:400:kworker.0 Request processed in 59us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536084.409641:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788536084.409656:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.409659:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569459456 00000100:00100000:0.0:1788536084.409664:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569459456 00000100:00100000:0.0:1788536084.409681:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569460096 00000100:00100000:0.0:1788536084.409684:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569460096 00010000:00080000:3.0:1788536084.409701:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487ad0700 x1875415569459968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536084.409726:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875415569459968:0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.409729:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788536084.409739:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569459456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.409783:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569459456:12345-0@lo:400:kworker.0 Request processed in 46us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536084.409790:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788536084.409801:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487ad0e00 x1875415569459456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536084.409807:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788536084.409814:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569460096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.409841:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569460096:12345-0@lo:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536084.409848:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788536084.409880:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569459072 00000100:00100000:0.0:1788536084.409883:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569459072 00000100:00100000:0.0:1788536084.409915:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569459584 00000100:00100000:0.0:1788536084.409918:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569459584 00000100:00100000:0.0:1788536084.409930:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788536084.409934:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569459072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.409967:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569459072:12345-0@lo:400:kworker.0 Request processed in 32us (5083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536084.409973:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788536084.409983:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788536084.409989:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569459584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.410085:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569459584:12345-0@lo:400:kworker.0 Request processed in 95us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536084.410091:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788536084.410121:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569459584:0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.410130:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569460224:0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.410177:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.410197:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569460224 00000100:00100000:0.0:1788536084.410200:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569460224 00000100:00100000:0.0:1788536084.410219:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788536084.410224:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059faf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569460224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536084.410251:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059faf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569460224:12345-0@lo:400:kworker.0 Request processed in 27us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536084.410257:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788536084.410354:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487ad0000 x1875415569460224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536084.410363:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569460224:0@lo:400:kworker.0 00000100:00100000:3.0:1788536084.413047:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569459456:0@lo:400:kworker.0 00010000:00080000:3.0:1788536084.413103:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487ad2a00 x1875415569460096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536084.413119:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569460096:0@lo:400:kworker.0 00000100:00100000:3.0:1788536084.413134:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569459072:0@lo:400:kworker.0 00000100:00100000:2.0:1788536084.415063:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536084.415137:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569458944 00000100:00100000:2.0:1788536084.415772:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569458944 00000100:00100000:2.0:1788536084.415959:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788536084.415970:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:3661:x1875415569458944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536084.416049:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:3661:x1875415569458944:12345-0@lo:400:kworker.0 Request processed in 82us (11468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536084.416057:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788536084.417296:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1875415569459200:12345-0@lo:8:kworker.0 Request processed in 17735us (17960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.417310:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788536084.417337:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569459712 00000100:00100000:1.0:1788536084.417344:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569459712 00000100:00100000:1.0:1788536084.417385:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788536084.417394:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569459712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536084.417449:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569459712:12345-0@lo:400:kworker.0 Request processed in 58us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.417455:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788536084.417466:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788536084.417470:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3659:x1875415569459328:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788536084.417491:0:18712:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788536084.417519:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3659:x1875415569459328:12345-0@lo:8:kworker.0 Request processed in 47us (18115us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788536084.417526:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788536084.417538:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788536084.417543:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3659:x1875415569459840:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788536084.417563:0:18712:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788536084.417597:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3659:x1875415569459840:12345-0@lo:8:kworker.0 Request processed in 52us (18151us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788536084.417605:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788536084.417668:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788536084.417673:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788536084.417675:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788536084.417735:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90048891c700 x1875415569459200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788536109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536084.417746:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788536084.417755:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788536084.417761:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788536084.417766:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788536084.417769:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059bfb2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788536084.417791:0:3659:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788536084.417797:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569459200:0@lo:8:kworker.0 00000100:00080000:1.0:1788536084.418269:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059b60e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788536084.418275:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788536084.418279:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569459328:0@lo:8:kworker.0 00000100:00080000:1.0:1788536084.418293:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788536084.418296:0:3659:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788536084.418299:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569459840:0@lo:8:kworker.0 00000004:00080000:1.0:1788536084.418369:0:17229:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788536084.418391:0:17229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17229:1875415569460480:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788536084.418431:0:17229:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.418463:0:17229:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105000 going to sleep for 11 seconds 00000100:00100000:1.0:1788536084.418478:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569460480 00000100:00100000:1.0:1788536084.418483:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569460480 00000100:00100000:1.0:1788536084.418520:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788536084.418526:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17229:x1875415569460480:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1788536084.421186:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788536084.421219:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788536084.421247:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569460352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788536084.421416:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.421443:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569460352 00000100:00100000:1.0:1788536084.421452:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569460352 00000100:00100000:1.0:1788536084.421511:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788536084.421519:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569460352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788536084.421554:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788536084.422785:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1875415569460352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.422803:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788536084.424724:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487ad3b80 x1875415569460352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788536100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536084.424753:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569460352:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788536084.429218:0:18712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788536084.429231:0:18712:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788536084.429238:0:18712:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:2.0:1788536084.430559:0:17228:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788536084.430654:0:17228:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 543234506846ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788536084.430662:0:17228:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788536084.431171:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569458944:0@lo:400:kworker.0 00010000:00080000:2.0:1788536084.431194:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff900487ad3480 x1875415569459712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788536100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536084.431206:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569459712:0@lo:400:kworker.0 00000004:00080000:2.0:1788536084.450760:0:17184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:01000000:0.0:1788536084.458674:0:19524:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788536084.458747:0:19524:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788536084.458752:0:19524:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788536084.458753:0:19524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788536084.458754:0:19524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536084.458755:0:19524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536084.458756:0:19524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536084.458757:0:19524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536084.458759:0:19524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536084.458760:0:19524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536084.458761:0:19524:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788536084.458764:0:19524:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788536084.458766:0:19524:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788536084.458767:0:19524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788536084.458768:0:19524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536084.458769:0:19524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536084.458771:0:19524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536084.458771:0:19524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536084.458772:0:19524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536084.458773:0:19524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536084.458774:0:19524:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788536084.458802:0:19524:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788536084.458841:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569460608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788536084.458928:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.459079:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788536084.466298:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569460608 00000100:00100000:2.0:1788536084.466312:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569460608 00000100:00100000:3.0:1788536084.467028:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788536084.467039:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:19524:x1875415569460608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788536084.467072:0:17198:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788536084.467075:0:17198:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788536084.467079:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788536084.468388:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:19524:x1875415569460608:12345-0@lo:253:mount.lustre.0 Request processed in 1346us (9455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536084.468399:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788536084.468500:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569460608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788536084.468515:0:19524:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788536084.468519:0:19524:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788536084.468521:0:19524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788536084.468522:0:19524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536084.468535:0:19524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536084.468536:0:19524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536084.468538:0:19524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536084.468539:0:19524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536084.468541:0:19524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536084.468542:0:19524:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788536084.468567:0:19524:0:(tgt_mount.c:101:server_register_mount()) register mount ffff900488af2800 from lustre-OST0001 10000000:01000000:0.0:1788536084.468596:0:19524:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788536084.468599:0:19524:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788536084.468618:0:19524:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90059fa94d40 local copy 00010000:00010000:0.0:1788536084.468629:0:19524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536084.469214:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569460736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536084.469255:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.469286:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbd80 going to sleep for 11 seconds 00002000:00010000:2.0:1788536084.469440:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536084.469449:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.469464:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1788536084.469477:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536084.469485:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.469504:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.469514:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.469522:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.469540:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788536084.469709:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569460736 00000100:00100000:3.0:1788536084.469724:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569460736 00000100:00100000:3.0:1788536084.469771:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788536084.469780:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:19524:x1875415569460736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536084.470198:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:19524:x1875415569460736:12345-0@lo:501:mount.lustre.0 Request processed in 418us (941us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788536084.470213:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788536084.470332:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569460736:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788536084.470349:0:19524:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788536084.470370:0:19524:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788536084.470377:0:19524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.470385:0:19524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620e400/0xe79af2f39bbdd559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd560 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536084.470412:0:19524:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff900488af2800 10000000:01000000:0.0:1788536084.470416:0:19524:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788536084.470422:0:19524:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788536084.470424:0:19524:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788536084.470428:0:19524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788536084.470431:0:19524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788536084.470457:0:19524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.470464:0:19524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.470473:0:19524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536084.470489:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569460864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788536084.470520:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.470542:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbd80 going to sleep for 11 seconds 00010000:00010000:1.0:1788536084.470799:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.470815:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.470832:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.470837:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.470859:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.470878:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.470886:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7f08213/0xe79af2f39bbdd84d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.470908:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.470910:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.470911:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536084.472247:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569460864 00000100:00100000:3.0:1788536084.472259:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569460864 00000100:00100000:3.0:1788536084.472322:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788536084.472332:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:19524:x1875415569460864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536084.472347:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536084.472362:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900580031c00/0xe79af2f39bbdd85b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd854 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.472390:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900580031c00/0xe79af2f39bbdd85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd854 expref: 22 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.472402:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900580031c00/0xe79af2f39bbdd85b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd854 expref: 22 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.472411:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900580031c00, rc 0) 00000100:00100000:3.0:1788536084.472480:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569460864:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536084.472486:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788536084.474005:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569460864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788536084.474035:0:19524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd85b expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.474059:0:19524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd85b expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788536084.476731:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536084.476747:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.476764:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1788536084.476769:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536084.476775:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.476791:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.476801:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.476854:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.477188:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:0.0:1788536084.479781:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00010000:00010000:3.0:1788536084.480979:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788536084.480996:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.481011:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067a00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:3.0:1788536084.481017:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788536084.481017:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536084.481031:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.481054:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.481076:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.481084:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f07de76/0xe79af2f39bbdd862 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.481103:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536084.481105:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536084.481106:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788536084.481414:0:19524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:2.0:1788536084.482055:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1788536084.482060:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536084.482068:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.482086:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.482098:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.482105:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.482130:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.482197:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.482204:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.482213:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.482217:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.482227:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.482241:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.482260:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7de1d42/0xe79af2f39bbdd869 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.482278:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.482280:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.482282:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536084.483211:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536084.483223:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.483245:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1788536084.483248:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536084.483254:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.483265:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.483273:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.483280:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.483306:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.483334:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.483342:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.483350:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.483355:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.483365:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.483380:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.483387:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd870 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.483406:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.483408:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.483410:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536084.486306:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536084.486321:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.486339:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1788536084.486344:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536084.486350:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.486363:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.486386:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.486395:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.486420:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.486667:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.486676:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.486687:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.486691:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.486701:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.486731:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.486740:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bc90aa6/0xe79af2f39bbdd877 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.486758:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.486759:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.486761:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536084.489573:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536084.489585:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.489600:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1788536084.489615:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536084.489621:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.489634:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.489645:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.489654:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.489692:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.489749:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.489758:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.489768:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.489773:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.489796:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.489813:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.489820:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000810f4cf6/0xe79af2f39bbdd87e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.489840:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.489842:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.489844:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536084.492107:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536084.492121:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.492139:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1788536084.492143:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536084.492177:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.492191:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.492203:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.492212:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.492332:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:0.0:1788536084.492533:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788536084.492569:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788536084.492581:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788536084.492592:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788536084.492604:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788536084.492614:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788536084.492634:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788536084.492639:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788536084.493271:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569460992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536084.493338:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.493386:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbe40 going to sleep for 11 seconds 00002000:00010000:3.0:1788536084.493454:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.493463:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493470:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788536084.493476:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788536084.493478:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.493480:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.493486:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493486:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.493491:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.493496:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493501:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.493504:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.493516:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493517:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.493532:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.493536:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002efb8263/0xe79af2f39bbdd885 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493554:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.493557:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493564:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.493567:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493575:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493585:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493591:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd88c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.493603:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.493605:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.493606:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.493622:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536084.493687:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569460992 00000100:00100000:2.0:1788536084.493879:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569460992 00000100:00100000:2.0:1788536084.493934:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788536084.493944:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569460992:12345-0@lo:501:mount.lustre.0 00002000:00010000:3.0:1788536084.493966:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.493984:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.493993:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788536084.494109:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.494115:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.494124:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.494130:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.494135:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536084.494250:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569460992:12345-0@lo:501:mount.lustre.0 Request processed in 307us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536084.494266:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:0.0:1788536084.494334:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.494340:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.494348:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.494352:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.494361:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.494376:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.494383:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788536084.494385:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.494388:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788536084.494389:0:18712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd893 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.494390:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536084.494419:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569460992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536084.494461:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536084.494504:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536084.494531:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569461120 00000100:00100000:0.0:1788536084.494534:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788536084.494538:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569461120 00000100:00100000:3.0:1788536084.494568:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788536084.494576:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569461120:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788536084.495289:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569461120:12345-0@lo:503:mount.lustre.0 Request processed in 710us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536084.495297:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788536084.495360:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461120:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788536084.495786:0:19524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536084.496059:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536084.496110:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.496250:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105480 going to sleep for 11 seconds 00002000:00010000:0.0:1788536084.496276:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536084.496285:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.496309:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788536084.496313:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536084.496319:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.496331:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.496339:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.496346:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.496366:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.496388:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.496396:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.496406:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.496410:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.496419:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.496437:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.496444:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd89a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.496462:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.496464:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.496465:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536084.496555:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569461248 00000100:00100000:2.0:1788536084.496562:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569461248 00000100:00100000:2.0:1788536084.496602:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788536084.496691:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569461248:12345-0@lo:502:mount.lustre.0 00002000:00010000:1.0:1788536084.497292:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536084.497300:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.497322:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788536084.497326:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536084.497331:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.497342:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.497352:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.497360:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.497373:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536084.497573:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.497579:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.497587:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620ea00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.497590:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.497600:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.497636:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.497646:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b550837/0xe79af2f39bbdd8a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.497665:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.497668:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.497671:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536084.497785:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569461248:12345-0@lo:502:mount.lustre.0 Request processed in 1096us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536084.497794:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788536084.498072:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788536084.498315:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788536084.498342:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788536084.498357:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788536084.498369:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788536084.498382:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788536084.498408:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788536084.498424:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788536084.498436:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788536084.498449:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788536084.498481:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536084.498531:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536084.498575:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff900585f05cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788536084.498594:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569461376 00000100:00100000:2.0:1788536084.498601:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569461376 00002000:00010000:1.0:1788536084.499042:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536084.499050:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.499063:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788536084.499067:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536084.499074:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.499086:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.499107:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.499115:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.499205:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788536084.499221:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788536084.499233:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569461376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536084.499355:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569461376:12345-0@lo:502:mount.lustre.0 Request processed in 123us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536084.499362:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788536084.499417:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788536084.499472:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788536084.499480:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00002000:00010000:1.0:1788536084.499626:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536084.499633:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.499642:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788536084.499645:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536084.499650:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.499660:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.499668:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.499674:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499724:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536084.499732:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499739:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.499743:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499751:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499766:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499784:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004656af96/0xe79af2f39bbdd8a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499812:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.499816:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499823:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620fe00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.499836:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499845:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499857:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.499864:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.499867:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.499869:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.500357:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788536084.500359:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.500364:0:18712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a2064c6/0xe79af2f39bbdd8af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788536084.500692:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.500699:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.500710:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788536084.500727:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.500739:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.500750:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.500760:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.500765:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.500805:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:01000000:3.0:1788536084.500968:0:19528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788536084.500974:0:19528:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788536084.500979:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536084.500980:0:19528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788536084.500985:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788536084.500996:0:19528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff900485ee99c0) 00000020:00000080:3.0:1788536084.501013:0:19528:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788536084.501016:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788536084.501078:0:19528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900488af2800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788536084.501086:0:19528:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788536084.501093:0:19528:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe79af2f39bbdd8c4 00010000:00010000:0.0:1788536084.501698:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.501705:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501727:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.501731:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501749:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501762:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501767:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc0aecc5/0xe79af2f39bbdd8b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501779:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.501780:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.501781:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536084.501893:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536084.501900:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501909:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788536084.501913:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536084.501919:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501929:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501937:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501951:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.501974:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.502270:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.502276:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502284:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839a00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.502287:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502294:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502306:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502313:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000064ba17a/0xe79af2f39bbdd8cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502326:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.502328:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.502329:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536084.502551:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536084.502556:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502562:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788536084.502564:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536084.502567:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502585:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502590:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502595:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502607:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.502627:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.502638:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502645:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.502648:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502656:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502668:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502675:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098736fac/0xe79af2f39bbdd8d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.502820:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.502822:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.502823:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536084.502932:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536084.502938:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502952:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788536084.502955:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536084.502960:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502970:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502977:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502982:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.502994:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.503014:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.503019:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.503026:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.503030:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.503051:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.503063:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.503070:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b466f1e7/0xe79af2f39bbdd8d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.503084:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.503086:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.503087:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536084.503606:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536084.503612:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.503621:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788536084.503625:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536084.503629:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.503639:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.503660:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.503666:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.503685:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.503937:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.503942:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.503951:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839600 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.503955:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.503963:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.503976:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.503995:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd8e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.504010:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.504011:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.504012:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536084.504239:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536084.504246:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.504249:0:19528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00010000:00010000:0.0:1788536084.504260:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788536084.504263:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536084.504268:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.504278:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.504285:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.504292:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.504320:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.504346:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.504351:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.504359:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839800 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.504363:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.504371:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.504383:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.504391:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6825d78/0xe79af2f39bbdd8e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.504407:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.504408:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.504410:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788536084.504621:0:19528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00002000:00010000:0.0:1788536084.504906:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536084.504912:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.504922:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788536084.504925:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536084.504929:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.504937:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.504944:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.504951:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.504972:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.505130:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536084.505143:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.505174:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.505178:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.505186:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.505210:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.505218:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dded9d43/0xe79af2f39bbdd8ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.505235:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.505237:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.505239:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788536084.506041:0:19528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00002000:00010000:3.0:1788536084.506325:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.506334:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506353:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788536084.506357:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.506363:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506377:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506387:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506395:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506415:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536084.506424:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.506431:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506440:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900580030e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.506452:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506461:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506475:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506483:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000136dd42/0xe79af2f39bbdd8f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506501:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.506503:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.506505:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788536084.506724:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.506731:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506740:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788536084.506744:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.506748:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506757:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506777:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506784:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.506800:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536084.506809:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.506815:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506824:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.506828:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506837:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506848:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506869:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd8fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.506888:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.506890:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.506892:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788536084.507093:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.507100:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788536084.507102:0:19528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00010000:00010000:3.0:1788536084.507111:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788536084.507114:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00000020:01000000:1.0:1788536084.507116:0:19528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00010000:3.0:1788536084.507119:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788536084.507124:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536084.507128:0:19528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00010000:00010000:3.0:1788536084.507131:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788536084.507133:0:19528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00010000:00010000:3.0:1788536084.507142:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788536084.507175:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00010000:00010000:3.0:1788536084.507177:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788536084.507179:0:19528:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788536084.507186:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788536084.507200:0:19528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00010000:00010000:3.0:1788536084.507208:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:01000000:1.0:1788536084.507214:0:19528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00010000:0.0:1788536084.507216:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:1.0:1788536084.507220:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536084.507221:0:19528:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00010000:00010000:0.0:1788536084.507221:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788536084.507224:0:19528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788536084.507228:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536084.507230:0:19528:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00010000:00010000:0.0:1788536084.507231:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632ee00 already unused, calling callback (ffffffffc0c0d530) 00000020:00000080:1.0:1788536084.507234:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00010000:00010000:0.0:1788536084.507234:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.507243:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.507254:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788536084.507258:0:19528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788536084.507262:0:19528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788536084.507263:0:19528:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00010000:00010000:0.0:1788536084.507263:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd903 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536084.507267:0:19528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00010000:00010000:0.0:1788536084.507280:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.507282:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.507283:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788536084.507321:0:19524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788536084.507371:0:19524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788536084.507390:0:19524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd85b expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.507407:0:19524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488838a00/0xe79af2f39bbdd854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd85b expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536084.507416:0:19524:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900488af2800 from 1 10000000:01000000:1.0:1788536084.507419:0:19524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00002000:00010000:3.0:1788536084.507454:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536084.507455:0:19524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507463:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.507466:0:19524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507484:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788536084.507487:0:19524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507489:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.507499:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507510:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536084.507519:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536084.507522:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507533:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507555:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788536084.507594:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.507641:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105840 going to sleep for 11 seconds 00010000:00010000:0.0:1788536084.507763:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.507769:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.507776:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.507780:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.507788:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.507800:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.507808:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000765892a2/0xe79af2f39bbdd90a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788536084.507922:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.507927:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507935:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788536084.507944:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.507949:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507958:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507966:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507973:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.507994:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536084.508063:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.508103:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.508107:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.508109:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788536084.508463:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.508470:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.508479:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788536084.508482:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.508485:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.508495:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.508503:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.508517:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.508534:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536084.508653:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.508659:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.508666:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.508670:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.508691:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.508705:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.508721:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089c589c5/0xe79af2f39bbdd91f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.508745:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.508749:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.508751:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.508754:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788536084.508961:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.508966:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.508974:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788536084.508977:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.508982:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.508990:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.508998:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.509006:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.509028:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536084.509176:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.509181:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509189:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51600 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.509192:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509199:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509211:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509230:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abae60b1/0xe79af2f39bbdd926 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509246:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.509248:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.509250:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788536084.509483:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536084.509489:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.509504:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788536084.509507:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536084.509511:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.509520:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.509527:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.509535:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.509566:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788536084.509603:0:18712:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788536084.509690:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17229:x1875415569460480:12345-0@lo:5:osp-pre-0-0.0 Request processed in 91161us (91255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536084.509699:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788536084.509768:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536084.509773:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509780:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51800 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536084.509784:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509792:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509805:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509813:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f785d7cc/0xe79af2f39bbdd92d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.509838:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.509841:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.509843:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.509953:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.509961:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f800 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536084.509965:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.509973:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.509983:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.509990:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c1adfb2/0xe79af2f39bbdd918 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.510005:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.510006:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536084.510008:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536084.510043:0:17229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17229:1875415569460480:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788536084.510058:0:17229:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788536084.510098:0:17229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17229:1875415569461632:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788536084.510131:0:17229:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536084.510237:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569461504 00000100:00100000:3.0:1788536084.510244:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569461504 00000100:00100000:3.0:1788536084.510282:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788536084.510291:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+22:19524:x1875415569461504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788536084.510304:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536084.510319:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd911 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.510356:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd911 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.510366:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd911 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536084.510373:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50000, rc 0) 00000100:00100000:3.0:1788536084.510410:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569461504:12345-0@lo:101:mount.lustre.0 Request processed in 120us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536084.510416:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788536084.510515:0:17229:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105000 going to sleep for 11 seconds 00000100:00100000:1.0:1788536084.510548:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536084.510563:0:19524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.510572:0:19524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536084.511610:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788536084.511938:0:19524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536084.512117:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788536084.512141:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788536084.512261:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788536084.512267:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788536084.512330:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536084.512383:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.512462:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788536084.512540:0:19157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569461632 00000100:00100000:0.0:1788536084.512547:0:19157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569461632 00000100:00100000:0.0:1788536084.512598:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536084.512608:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17229:x1875415569461632:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788536084.512643:0:19157:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:3.0:1788536084.514940:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569461760 00000100:00100000:3.0:1788536084.514951:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569461760 00000100:00100000:3.0:1788536084.516266:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788536084.516280:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569461760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788536084.516460:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569461760:12345-0@lo:501:mount.lustre.0 Request processed in 184us (4075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536084.516468:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788536084.516559:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788536084.516613:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788536084.516664:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.517383:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569461888 00000100:00100000:1.0:1788536084.517391:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569461888 00000100:00100000:1.0:1788536084.517430:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788536084.517438:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569461888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536084.517534:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569461888:12345-0@lo:503:mount.lustre.0 Request processed in 97us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.517542:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788536084.518251:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff900589627a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788536084.518278:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569461888:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788536084.518733:0:19524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536084.518812:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536084.518890:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.518912:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488105840 going to sleep for 11 seconds 00000100:00100000:3.0:1788536084.518982:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569462016 00000100:00100000:3.0:1788536084.518988:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569462016 00000100:00100000:3.0:1788536084.519034:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788536084.519043:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569462016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536084.519137:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569462016:12345-0@lo:502:mount.lustre.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536084.519175:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788536084.519314:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536084.519505:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788536084.519534:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788536084.519554:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788536084.519570:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788536084.519599:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788536084.519613:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788536084.519624:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788536084.519637:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788536084.519651:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788536084.519666:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788536084.519680:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788536084.519704:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536084.519754:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.519779:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff900589627a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788536084.519833:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569462144 00000100:00100000:3.0:1788536084.519839:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569462144 00000100:00100000:3.0:1788536084.519878:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788536084.519885:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569462144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788536084.519956:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569462144:12345-0@lo:502:mount.lustre.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536084.519963:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788536084.520040:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788536084.520079:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788536084.520087:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788536084.521133:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536084.521143:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536084.521178:0:19533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788536084.521186:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff900488af2800 00000020:00000080:3.0:1788536084.521189:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788536084.521196:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536084.521199:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536084.521200:0:19533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788536084.521202:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536084.521204:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536084.521205:0:19533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788536084.521209:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff900488af2800 00000020:00000080:3.0:1788536084.521211:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788536084.521265:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536084.521269:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536084.521271:0:19533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788536084.521274:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536084.521276:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536084.521278:0:19533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788536084.521282:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff900488af2800 00000020:00000080:3.0:1788536084.521284:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788536084.521305:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536084.521308:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536084.521309:0:19533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788536084.521311:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788536084.521314:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536084.521315:0:19533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788536084.521328:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff900488af2800 00000020:00000080:3.0:1788536084.521331:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788536084.521359:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788536084.521363:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788536084.521364:0:19533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788536084.521367:0:19533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788536084.521500:0:19524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788536084.521530:0:19524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536084.521559:0:19524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.521572:0:19524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536084.521625:0:19524:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788536084.521633:0:19524:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff900488af2800 10000000:01000000:1.0:1788536084.521636:0:19524:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff900488af2800 10000000:01000000:1.0:1788536084.521641:0:19524:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788536084.521647:0:19524:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff900488af2800 from 1 10000000:01000000:1.0:1788536084.521650:0:19524:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788536084.521683:0:19524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620fe00/0xe79af2f39bbdd93b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.521693:0:19524:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059620fe00/0xe79af2f39bbdd93b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.521703:0:19524:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059620fe00/0xe79af2f39bbdd93b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536084.521737:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788536084.521800:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.521844:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569462272 00000100:00100000:1.0:1788536084.521852:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569462272 00000100:00100000:1.0:1788536084.521889:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788536084.521897:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+23:19524:x1875415569462272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536084.521907:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536084.521919:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059620ea00/0xe79af2f39bbdd942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd93b expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.521943:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059620ea00/0xe79af2f39bbdd942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd93b expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.521954:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059620ea00/0xe79af2f39bbdd942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd93b expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.521973:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620ea00, rc 0) 00000100:00100000:1.0:1788536084.522006:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462272:12345-0@lo:101:mount.lustre.0 Request processed in 109us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.522012:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788536084.522056:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff900589627a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788536084.522076:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788536084.522090:0:19524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059620fe00/0xe79af2f39bbdd93b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd942 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.522099:0:19524:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059620fe00/0xe79af2f39bbdd93b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd942 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788536084.526753:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788536084.527067:0:19524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788536084.527306:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788536084.527334:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788536084.527355:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788536084.527372:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788536084.527406:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788536084.527426:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788536084.527443:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788536084.527461:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788536084.527478:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788536084.527496:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788536084.527514:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788536084.527531:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788536084.527551:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788536084.527570:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788536084.527597:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788536084.527613:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788536084.527631:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788536084.527646:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788536084.527663:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788536084.527680:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788536084.527811:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788536084.527834:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788536084.527852:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788536084.527869:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788536084.527882:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788536084.527895:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788536084.527908:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788536084.527920:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788536084.527933:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788536084.527946:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788536084.527958:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788536084.527969:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788536084.527982:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788536084.527995:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788536084.528007:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788536084.528020:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788536084.528051:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788536084.528074:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788536084.528093:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788536084.528115:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788536084.528139:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788536084.528186:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788536084.528203:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788536084.528223:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788536084.528241:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788536084.528255:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788536084.528279:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788536084.528294:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788536084.528409:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536084.528479:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.528536:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569462400 00000100:00100000:1.0:1788536084.528542:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569462400 00000100:00100000:1.0:1788536084.528586:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788536084.528595:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536084.528710:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462400:12345-0@lo:501:mount.lustre.0 Request processed in 115us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.528733:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788536084.528792:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536084.528816:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788536084.528854:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536084.528893:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.528914:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569462528 00000100:00100000:1.0:1788536084.528918:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569462528 00000100:00100000:1.0:1788536084.528939:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788536084.528945:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788536084.529016:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462528:12345-0@lo:503:mount.lustre.0 Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.529024:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788536084.529060:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059e1baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536084.529072:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462528:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788536084.529460:0:19524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788536084.529522:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536084.529570:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.529594:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569462656 00000100:00100000:1.0:1788536084.529598:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569462656 00000100:00100000:1.0:1788536084.529620:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788536084.529626:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536084.529696:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462656:12345-0@lo:502:mount.lustre.0 Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.529702:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000001:00080000:0.0:1788536084.530233:0:18707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788536084.530270:0:18707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788536084.530370:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17229:x1875415569461632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17763us (20238us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788536084.530378:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536084.530950:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788536084.530973:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788536084.531180:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788536084.531207:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788536084.531223:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788536084.531237:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788536084.531252:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788536084.531265:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788536084.531280:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788536084.531293:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788536084.531308:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788536084.531324:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788536084.531340:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788536084.531357:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788536084.531372:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788536084.531399:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788536084.531413:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788536084.531429:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788536084.531445:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788536084.531458:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788536084.531472:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788536084.531488:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788536084.531503:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788536084.531518:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788536084.531535:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788536084.531552:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788536084.531569:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788536084.531583:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788536084.531595:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788536084.531607:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788536084.531619:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788536084.531632:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788536084.531647:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788536084.531681:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788536084.531696:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788536084.531721:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788536084.531739:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788536084.531754:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788536084.531769:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788536084.531784:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788536084.531800:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788536084.531815:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788536084.531901:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788536084.531920:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788536084.531933:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788536084.531950:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788536084.531963:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788536084.531977:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788536084.532006:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788536084.532033:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788536084.532085:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536084.532177:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.532218:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005831356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788536084.532971:0:17229:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788536084.532980:0:17229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17229:1875415569461632:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788536084.532992:0:17229:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:1.0:1788536084.533507:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569462784 00000100:00100000:1.0:1788536084.533516:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569462784 00000100:00100000:1.0:1788536084.533612:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788536084.533623:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788536084.533783:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462784:12345-0@lo:502:mount.lustre.0 Request processed in 161us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.533791:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788536084.535250:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788536084.535658:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788536084.535692:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788536084.535846:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788536084.535968:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536084.536703:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788536084.537690:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569462912 00000100:00100000:0.0:1788536084.537699:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569462912 00000100:00100000:0.0:1788536084.537759:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788536084.537769:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788536084.537975:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569462912:12345-0@lo:502:mount.lustre.0 Request processed in 207us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536084.537984:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788536084.538392:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569462912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788536084.538670:0:19524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788536084.538760:0:19524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788536084.539764:0:19538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788536084.539779:0:19538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff900488accd40) 00000020:00000080:2.0:1788536084.539814:0:19538:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788536084.539994:0:19538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900488af2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788536084.539998:0:19538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff900488af2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788536084.540001:0:19538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff900488af2800 3 00010000:00080000:2.0:1788536084.540033:0:19538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff900485dfd800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1788536084.542324:0:19538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788536084.544103:0:19538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788536084.544177:0:19538:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788536084.544192:0:19538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe79af2f39bbdd950 00000100:00080000:2.0:1788536084.544203:0:19538:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788536084.544210:0:19538:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff900485dfd800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788536084.544248:0:19538:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb04e00 x1875415569463040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788536084.544270:0:19538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788536084.545026:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3659:1875415569463040:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788536084.545098:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.545372:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569463040 00000100:00100000:1.0:1788536084.545380:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569463040 00000100:00100000:1.0:1788536084.545417:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788536084.545424:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3659:x1875415569463040:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788536084.545449:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:1.0:1788536084.545497:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe79af2f39bbdd957 00000004:00100000:1.0:1788536084.545511:0:17204:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000004:2.0:1788536084.545706:0:19538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788536084.545733:0:19538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff900488ac8000) 00000020:00000080:2.0:1788536084.545759:0:19538:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788536084.545828:0:19538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff900488af2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788536084.545832:0:19538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff900488af2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788536084.545834:0:19538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff900488af2800 3 00010000:00080000:2.0:1788536084.545927:0:19538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff900485df9000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.113@tcp at head 00000100:00080000:1.0:1788536084.546228:0:17204:0:(import.c:65:import_set_state_nolock()) ffff900488ac1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536084.546355:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875415569463040:12345-0@lo:38:llog_process_th.0 Request processed in 927us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.546373:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788536084.546428:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059fb04e00 x1875415569463040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788536094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788536084.546438:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788536084.546446:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788536084.546453:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788536084.546458:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788536084.546461:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900485dfd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788536084.546468:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3659:1875415569463040:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1788536084.548390:0:19538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788536084.549134:0:19538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788536084.549200:0:19538:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788536084.549218:0:19538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe79af2f39bbdd965 00000100:00080000:2.0:1788536084.549230:0:19538:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788536084.549236:0:19538:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff900485df9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1788536084.549271:0:19538:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90059fb06d80 x1875415569463168/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788536084.549311:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3659:1875415569463168:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788536084.549383:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788536084.549446:0:19538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788536084.549688:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569463168 00000100:00100000:3.0:1788536084.549696:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569463168 00000100:00100000:3.0:1788536084.551805:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788536084.551817:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1875415569463168:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788536084.551850:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:3.0:1788536084.551888:0:17206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe79af2f39bbdd96c 00000004:00100000:3.0:1788536084.551905:0:17206:0:(mdt_handler.c:7341:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788536084.551938:0:17206:0:(import.c:65:import_set_state_nolock()) ffff900486a08000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788536084.552020:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875415569463168:12345-0@lo:38:llog_process_th.0 Request processed in 203us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536084.552027:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788536084.553349:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90059fb06d80 x1875415569463168/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788536094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536084.553364:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788536084.553373:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788536084.553380:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788536084.553386:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788536084.553389:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900485df9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788536084.553396:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3659:1875415569463168:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788536084.554475:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788536084.554670:0:19524:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788536084.554702:0:19524:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788536084.554733:0:19524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059620fe00/0xe79af2f39bbdd93b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd942 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.554745:0:19524:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059620fe00/0xe79af2f39bbdd93b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd942 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788536084.554800:0:19524:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788536084.554802:0:19524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788536084.554804:0:19524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536084.554805:0:19524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536084.554806:0:19524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536084.554808:0:19524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536084.554814:0:19524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536084.554816:0:19524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536084.554817:0:19524:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788536084.554821:0:19524:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788536084.555007:0:19524:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788536084.555010:0:19524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788536084.555011:0:19524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536084.555011:0:19524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536084.555012:0:19524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536084.555014:0:19524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536084.555015:0:19524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536084.555016:0:19524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536084.555017:0:19524:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788536084.555042:0:19524:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788536084.555062:0:19524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569463296:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788536084.555133:0:19524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536084.555201:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569463296 00000100:00100000:0.0:1788536084.555209:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569463296 00000100:00100000:0.0:1788536084.555255:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788536084.555266:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569463296:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788536084.555289:0:17198:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788536084.555303:0:17198:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788536084.555426:0:19524:0:(client.c:2716:ptlrpc_set_wait()) set ffff900583135a80 going to sleep for 11 seconds 20000000:01000000:0.0:1788536084.558039:0:17198:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788536084.559095:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788536084.560599:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+24:19524:x1875415569463296:12345-0@lo:253:mount.lustre.0 Request processed in 5327us (5456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536084.560615:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788536084.560693:0:19524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25821a76-2177-4c11-bd6b-eb660028a815:19524:1875415569463296:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788536084.560709:0:19524:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788536084.560725:0:19524:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788536084.560727:0:19524:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788536084.560735:0:19524:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788536084.560737:0:19524:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788536084.560738:0:19524:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788536084.560740:0:19524:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788536084.560741:0:19524:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788536084.560742:0:19524:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788536084.560744:0:19524:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788536084.560770:0:19524:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788536084.561008:0:17220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788536084.561014:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788536084.561035:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561050:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd815 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561059:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd823 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561080:0:17220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561127:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd823 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561143:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd823 expref: 23 pid: 17197 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536084.561174:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569463424:0@lo:104: 00000100:00100000:2.0:1788536084.561231:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788536084.561285:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd815 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561308:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd815 expref: 23 pid: 17196 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536084.561316:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb07b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569463552:0@lo:104: 00000100:00100000:2.0:1788536084.561345:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536084.561364:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788536084.561385:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569463424 00000100:00100000:2.0:1788536084.561390:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569463424 00000100:00100000:2.0:1788536084.561420:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569463552 00000100:00100000:2.0:1788536084.561433:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569463552 00000100:00100000:2.0:1788536084.561449:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788536084.561457:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+4:17220:x1875415569463424:12345-0@lo:104: 00010000:00010000:2.0:1788536084.561470:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561536:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788536084.561542:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+4:17220:x1875415569463424:12345-0@lo:104: Request processed in 86us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536084.561548:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788536084.561562:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788536084.561569:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+3:17220:x1875415569463552:12345-0@lo:104: 00010000:00010000:2.0:1788536084.561576:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561619:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788536084.561625:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25821a76-2177-4c11-bd6b-eb660028a815+3:17220:x1875415569463552:12345-0@lo:104: Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536084.561631:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788536084.561737:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536084.561745:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.561755:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e200 already unused, calling callback (ffffffffc120ac20) 00000100:00100000:2.0:1788536084.561759:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569463424:0@lo:104: 10000000:00010000:0.0:1788536084.561761:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536084.561773:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb07b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875415569463552:0@lo:104: 00010000:00010000:0.0:1788536084.561774:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788536084.561785:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536084.561792:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788536084.561795:0:17220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561813:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536084.561817:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561824:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e600 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:2.0:1788536084.561827:0:19531:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.561835:0:19531:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788536084.561847:0:19531:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788536084.561852:0:19531:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788536084.561949:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.561956:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788536084.561977:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.561984:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059620e200/0xe79af2f39bbdd823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd82a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536084.561995:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.562003:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536084.562005:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536084.562019:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569463680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788536084.562064:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536084.562477:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569463680 00000100:00100000:1.0:1788536084.562484:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569463680 00010000:00010000:1.0:1788536084.562512:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd823 expref: 24 pid: 17197 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536084.562548:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788536084.562557:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25821a76-2177-4c11-bd6b-eb660028a815+24:3662:x1875415569463680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536084.562570:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536084.562576:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd823 expref: 24 pid: 17197 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.562588:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd823 expref: 24 pid: 17197 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.562602:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488839200/0xe79af2f39bbdd82a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd823 expref: 24 pid: 17197 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536084.562614:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788536084.562657:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25821a76-2177-4c11-bd6b-eb660028a815+23:3662:x1875415569463680:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536084.562664:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788536084.562725:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569463680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788536084.562811:0:19531:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.562820:0:19531:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788536084.562839:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.562846:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059620e600/0xe79af2f39bbdd815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd81c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536084.562867:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569463808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536084.562960:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536084.563009:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569463808 00000100:00100000:2.0:1788536084.563014:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569463808 00010000:00010000:2.0:1788536084.563031:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd815 expref: 23 pid: 17196 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536084.563054:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788536084.563061:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25821a76-2177-4c11-bd6b-eb660028a815+23:3663:x1875415569463808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788536084.563070:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536084.563074:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd815 expref: 23 pid: 17196 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563085:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd815 expref: 23 pid: 17196 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563192:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900580031a00/0xe79af2f39bbdd81c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd815 expref: 23 pid: 17196 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563204:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563212:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788536084.563225:0:17190:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003290456s 00010000:00010000:2.0:1788536084.563230:0:17190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563238:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563246:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563253:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563259:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788536084.563264:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563272:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563287:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563357:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536084.563389:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25821a76-2177-4c11-bd6b-eb660028a815+22:3663:x1875415569463808:12345-0@lo:103:ldlm_bl.0 Request processed in 328us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536084.563396:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788536084.563424:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569463808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788536084.563443:0:17220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563451:0:17220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563457:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488066e00/0xe79af2f39bbdd973 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536084.563472:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536084.563475:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536084.563476:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788536084.563731:0:19524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788536084.569298:0:19524:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788536084.569308:0:19524:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788536084.569345:0:19524:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788536084.569386:0:19524:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788536084.569405:0:19524:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788536084.569431:0:19524:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788536084.572996:0:19524:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788536084.573255:0:19524:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788536084.589242:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788536085.401530:0:19591:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788536085.401790:0:19591:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788536085.613994:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788536086.325747:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788536086.325755:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff900590d0d800 from 10 10000000:01000000:2.0:1788536086.325761:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788536086.325827:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488066400/0xe79af2f39bbdd97a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536086.325851:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488066400/0xe79af2f39bbdd97a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536086.325871:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488066400/0xe79af2f39bbdd97a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536086.325897:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569463936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788536086.325970:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536086.326056:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900590741cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536086.330172:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569463936 00000100:00100000:1.0:1788536086.330187:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569463936 00000100:00100000:1.0:1788536086.330263:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788536086.330273:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+22:17202:x1875415569463936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536086.330291:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536086.330314:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059620f000/0xe79af2f39bbdd981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd97a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536086.330343:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059620f000/0xe79af2f39bbdd981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd97a expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536086.330355:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059620f000/0xe79af2f39bbdd981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd97a expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536086.330365:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f000, rc 0) 00000100:00100000:1.0:1788536086.330443:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569463936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (4474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536086.330450:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788536086.331222:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569463936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536086.331242:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488066400/0xe79af2f39bbdd97a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd981 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536086.331254:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488066400/0xe79af2f39bbdd97a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd981 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536086.331320:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569464064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788536086.331364:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536086.331392:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900586422300 going to sleep for 11 seconds 00000100:00100000:0.0:1788536086.331407:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569464064 00000100:00100000:0.0:1788536086.331412:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569464064 00000100:00100000:0.0:1788536086.331439:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788536086.331446:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569464064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788536086.331459:0:17198:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788536086.331475:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788536086.331478:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788536086.331545:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569464064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536086.331558:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788536086.331676:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569464064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788536086.331746:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788536086.331754:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488066400/0xe79af2f39bbdd97a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd981 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536086.331763:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488066400/0xe79af2f39bbdd97a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd981 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536086.331773:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788536086.331776:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff900586554800 from 10 10000000:01000000:0.0:1788536086.331779:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788536086.331798:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488839a00/0xe79af2f39bbdd988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536086.331805:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488839a00/0xe79af2f39bbdd988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536086.331814:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488839a00/0xe79af2f39bbdd988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536086.331826:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569464192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788536086.331849:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536086.331867:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900586422300 going to sleep for 11 seconds 00000100:00100000:2.0:1788536086.333877:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569464192 00000100:00100000:2.0:1788536086.333891:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569464192 00000100:00100000:2.0:1788536086.333948:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788536086.333957:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569464192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536086.333974:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536086.333990:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488066600/0xe79af2f39bbdd98f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbdd988 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536086.334019:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488066600/0xe79af2f39bbdd98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbdd988 expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536086.334032:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488066600/0xe79af2f39bbdd98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd988 expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536086.334041:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066600, rc 0) 00000100:00100000:2.0:1788536086.334109:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:17202:x1875415569464192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536086.334115:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788536086.334197:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569464192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536086.334215:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488839a00/0xe79af2f39bbdd988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd98f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536086.334225:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488839a00/0xe79af2f39bbdd988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbdd98f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536086.334479:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569464320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788536086.334515:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536086.334545:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788536086.334560:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569464320 00000100:00100000:2.0:1788536086.334564:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569464320 00000100:00100000:2.0:1788536086.334588:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788536086.334594:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:17202:x1875415569464320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788536086.334607:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788536086.334622:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788536086.334625:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788536086.334883:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:17202:x1875415569464320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 288us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536086.334890:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788536086.334920:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569464320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788536086.334978:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788536086.334986:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488839a00/0xe79af2f39bbdd988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd98f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536086.334995:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488839a00/0xe79af2f39bbdd988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbdd98f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536086.643753:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536086.958181:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788536086.958204:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569464448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788536086.959459:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536086.961620:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569464448 00000100:00100000:3.0:1788536086.961640:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569464448 00000100:00100000:3.0:1788536086.961713:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788536086.961725:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569464448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788536086.961764:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788536086.961847:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569464448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536086.961854:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788536086.961916:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569464448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788536087.470568:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788536087.470594:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569464576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788536087.470664:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536087.470762:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569464576 00000100:00100000:0.0:1788536087.470773:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569464576 00000100:00100000:0.0:1788536087.470831:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788536087.470842:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569464576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788536087.470889:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788536087.470938:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569464576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536087.470944:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788536087.470988:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569464576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788536087.471097:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788536087.471107:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569464704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788536087.471191:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536087.471226:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569464704 00000100:00100000:3.0:1788536087.471230:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569464704 00000100:00100000:3.0:1788536087.471266:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788536087.471273:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569464704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788536087.471293:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788536087.471325:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569464704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536087.471331:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788536087.471347:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788536087.471372:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569464704:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788536087.660449:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536088.692562:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536089.519768:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788536089.519794:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569464832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788536089.519860:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536089.519919:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569464832 00000100:00100000:3.0:1788536089.519927:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569464832 00000100:00100000:3.0:1788536089.519983:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788536089.519992:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569464832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788536089.520024:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788536089.520069:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569464832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536089.520076:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788536089.520097:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788536089.520135:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569464832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788536089.708394:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788536090.037366:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536090.037380:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788536090.037384:0:36:0:(import.c:65:import_set_state_nolock()) ffff90059b60e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536090.037392:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 543 00000100:00080000:3.0:1788536090.037397:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788536090.037403:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90059b60e800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536090.037427:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff900488872a00 x1875415569465216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788536090.037474:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788536090.037477:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788536090.037479:0:36:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788536090.037483:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:3.0:1788536090.037485:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788536090.037489:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff900589926000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1788536090.037500:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90048891c000 x1875415569465728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788536090.037554:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569465344:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.037615:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.037685:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569465984:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.037709:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.037741:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788536090.037748:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569465472:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.037774:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.037793:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569466112:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.037815:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.037857:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569465344 00000100:00100000:3.0:1788536090.037865:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569465344 00000100:00100000:3.0:1788536090.037899:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569465984 00000100:00100000:3.0:1788536090.037902:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569465984 00000100:00100000:3.0:1788536090.037925:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569466112 00000100:00100000:3.0:1788536090.037928:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569466112 00000100:00100000:3.0:1788536090.037945:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788536090.037954:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569465344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038020:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875415569465344:12345-0@lo:400:kworker.0 Request processed in 66us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.038028:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788536090.038044:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788536090.038049:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569465984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038073:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875415569465984:12345-0@lo:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.038078:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788536090.038088:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788536090.038094:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569466112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038115:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569466112:12345-0@lo:400:kworker.0 Request processed in 21us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.038120:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788536090.038139:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569465472 00000100:00100000:3.0:1788536090.038142:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569465472 00000100:00100000:3.0:1788536090.038207:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788536090.038213:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569465472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038245:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569465472:12345-0@lo:400:kworker.0 Request processed in 31us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.038260:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788536090.038280:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788536090.038284:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788536090.038314:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569465472:0@lo:400:kworker.0 00010000:00080000:3.0:1788536090.038325:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fbc5880 x1875415569466112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536090.038334:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569466112:0@lo:400:kworker.0 00010000:00080000:3.0:1788536090.038342:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488873800 x1875415569465344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536090.038351:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875415569465344:0@lo:400:kworker.0 00010000:00080000:3.0:1788536090.038359:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048891ca80 x1875415569465984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536090.038367:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3662:1875415569465984:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038404:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569465088:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038429:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.038455:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569465856:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038475:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.038491:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569466368:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038515:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.038533:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788536090.038539:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569464960:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038565:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.038595:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569465600:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038619:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.038637:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569466240:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038659:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.038694:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569465088 00000100:00100000:3.0:1788536090.038698:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569465088 00000100:00100000:3.0:1788536090.038722:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788536090.038728:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569465088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038761:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569465088:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.038766:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788536090.038786:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569465600 00000100:00100000:3.0:1788536090.038790:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569465600 00000100:00100000:3.0:1788536090.038820:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788536090.038826:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569465600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038856:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569465600:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.038862:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788536090.038880:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569465856 00000100:00100000:3.0:1788536090.038883:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569465856 00000100:00100000:3.0:1788536090.038898:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569466368 00000100:00100000:3.0:1788536090.038900:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569466368 00000100:00100000:3.0:1788536090.038912:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569466240 00000100:00100000:3.0:1788536090.038914:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569466240 00000100:00100000:3.0:1788536090.038927:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788536090.038932:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569465856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.038960:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569465856:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.038974:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788536090.038986:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788536090.038991:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569466368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.039019:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569466368:12345-0@lo:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.039024:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788536090.039035:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788536090.039040:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569466240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.039064:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569466240:12345-0@lo:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.039069:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788536090.039086:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788536090.039088:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788536090.039091:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788536090.039113:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569465600:0@lo:400:kworker.0 00010000:00080000:3.0:1788536090.039125:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fbc7b80 x1875415569466240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536090.039134:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569466240:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.039142:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569465088:0@lo:400:kworker.0 00010000:00080000:3.0:1788536090.039177:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048891c700 x1875415569465856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536090.039184:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569465856:0@lo:400:kworker.0 00010000:00080000:3.0:1788536090.039192:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fbc6a00 x1875415569466368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536090.039206:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569466368:0@lo:400:kworker.0 00000100:00100000:3.0:1788536090.039245:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569465216:0@lo:8:kworker.0 00000100:00100000:3.0:1788536090.039276:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.039296:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569465728:0@lo:8:kworker.0 00000100:00100000:3.0:1788536090.039316:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.039344:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569465216 00000100:00100000:3.0:1788536090.039348:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569465216 00000100:00100000:3.0:1788536090.039364:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569465728 00000100:00100000:3.0:1788536090.039366:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569465728 00000100:00100000:3.0:1788536090.039376:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788536090.039381:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3659:x1875415569465216:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788536090.039405:0:18711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1788536090.039432:0:18711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe79af2f39bbdd996 00002000:00100000:3.0:1788536090.039445:0:18711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90059dc5c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788536090.039449:0:18711:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788536090.039451:0:18711:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788536090.039637:0:18711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788536090.039664:0:18711:0:(import.c:65:import_set_state_nolock()) ffff90059dc5e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788536090.039718:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1875415569465216:12345-0@lo:8:kworker.0 Request processed in 335us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.039725:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788536090.039738:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788536090.039742:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3659:x1875415569465728:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788536090.039756:0:18711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1788536090.039782:0:18711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe79af2f39bbdd99d 00002000:00100000:3.0:1788536090.039789:0:18711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90059dc5d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788536090.039792:0:18711:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788536090.039794:0:18711:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788536090.039819:0:18711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788536090.039831:0:18711:0:(import.c:65:import_set_state_nolock()) ffff90059dc5d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788536090.039859:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3659:x1875415569465728:12345-0@lo:8:kworker.0 Request processed in 115us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.039865:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788536090.039904:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488872a00 x1875415569465216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788536115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536090.039912:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788536090.039918:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788536090.039925:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788536090.039930:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788536090.039932:0:3659:0:(import.c:65:import_set_state_nolock()) ffff90059b60e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788536090.039956:0:3659:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788536090.039961:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3659:1875415569465216:0@lo:8:kworker.0 00010000:00080000:3.0:1788536090.039973:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90048891c000 x1875415569465728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788536115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536090.039981:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788536090.039984:0:3659:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788536090.039988:0:3659:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788536090.039991:0:3659:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788536090.039993:0:3659:0:(import.c:65:import_set_state_nolock()) ffff900589926000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788536090.040005:0:3659:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788536090.040016:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3659:1875415569465728:0@lo:8:kworker.0 00000004:00080000:3.0:1788536090.040067:0:17231:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788536090.040084:0:17231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17231:1875415569466624:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788536090.040109:0:17231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.040126:0:17231:0:(client.c:2716:ptlrpc_set_wait()) set ffff900488207d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788536090.040136:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788536090.040143:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569466496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788536090.040191:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536090.040215:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569466496 00000100:00100000:3.0:1788536090.040219:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569466496 00000100:00100000:3.0:1788536090.040252:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788536090.040259:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875415569466496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788536090.040276:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788536090.040309:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875415569466496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536090.040314:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788536090.040332:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788536090.040347:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fbc4380 x1875415569466496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788536106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536090.040360:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569466496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788536090.040379:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569466624 00000100:00100000:3.0:1788536090.040382:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569466624 00000100:00100000:3.0:1788536090.040402:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788536090.040408:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17231:x1875415569466624:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788536090.041232:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569464960 00000100:00100000:2.0:1788536090.041241:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569464960 00000100:00100000:2.0:1788536090.041276:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788536090.041284:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:3661:x1875415569464960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536090.041339:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:3661:x1875415569464960:12345-0@lo:400:kworker.0 Request processed in 56us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536090.041346:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000004:00080000:2.0:1788536090.041403:0:17949:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788536090.041420:0:17949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb05f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875415569466880:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788536090.041449:0:17949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536090.041469:0:17949:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d46e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788536090.041483:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569466880 00000100:00100000:2.0:1788536090.041487:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569466880 00000100:00100000:2.0:1788536090.041527:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788536090.041533:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17949:x1875415569466880:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1788536090.041569:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788536090.041582:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569466752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788536090.041610:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536090.041645:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569466752 00000100:00100000:2.0:1788536090.041649:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569466752 00000100:00100000:2.0:1788536090.041671:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788536090.041690:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3663:x1875415569466752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788536090.041713:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788536090.041747:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3663:x1875415569466752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536090.041753:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788536090.041785:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb06680 x1875415569466752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788536106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536090.041800:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569466752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788536090.041831:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25821a76-2177-4c11-bd6b-eb660028a815:3661:1875415569464960:0@lo:400:kworker.0 00000004:00080000:2.0:1788536090.042041:0:17230:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788536090.042116:0:17230:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 548845968819ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788536090.042122:0:17230:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788536090.042641:0:17948:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788536090.042702:0:17948:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 548846554595ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788536090.042707:0:17948:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788536090.061635:0:17937:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1788536090.062261:0:17184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788536090.065476:0:18711:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788536090.065488:0:18711:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788536090.065494:0:18711:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:0.0:1788536090.073205:0:18712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788536090.073218:0:18712:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788536090.073322:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17949:x1875415569466880:12345-0@lo:7:osp-pre-1-1.0 Request processed in 31784us (31867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536090.073333:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788536090.073395:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb05f80 x1875415569466880/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788536106 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536090.073411:0:17949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb05f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875415569466880:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788536090.073425:0:17949:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788536090.073470:0:17949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875415569467008:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788536090.073505:0:17949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536090.073529:0:17949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004822db240 going to sleep for 11 seconds 00000100:00100000:0.0:1788536090.073548:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569467008 00000100:00100000:0.0:1788536090.073555:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569467008 00000100:00100000:0.0:1788536090.073595:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788536090.073605:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17949:x1875415569467008:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788536090.073631:0:18713:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788536090.073658:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17949:x1875415569467008:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536090.073693:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788536090.073726:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004888dd180 x1875415569467008/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788536106 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536090.073735:0:17949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875415569467008:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788536090.073743:0:17949:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788536090.073767:0:17949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875415569467136:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788536090.073790:0:17949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536090.073804:0:17949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004822db240 going to sleep for 11 seconds 00000100:00100000:0.0:1788536090.073815:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569467136 00000100:00100000:0.0:1788536090.073818:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569467136 00000100:00100000:0.0:1788536090.073839:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788536090.073845:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17949:x1875415569467136:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788536090.073869:0:18712:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1788536090.087410:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536090.087422:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.087439:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788536090.087444:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536090.087450:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.087468:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.087491:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.087499:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.087763:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788536090.091576:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536090.091588:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.091604:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788536090.091609:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536090.091615:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.091629:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.091640:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.091648:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.095195:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788536090.095211:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.095238:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536090.095243:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.095255:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.095281:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.095290:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad0ee33/0xe79af2f39bbdd9a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102072:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536090.102093:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.102102:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102115:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.102121:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102133:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102165:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102174:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102197:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.102199:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.102200:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.102207:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.102209:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.102210:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536090.102703:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536090.102711:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102729:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788536090.102733:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536090.102740:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102753:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102762:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.102770:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.104346:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536090.104365:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.104373:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.104384:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839800 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.104389:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.104399:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.104429:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.104437:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.104454:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.104456:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.104458:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536090.106299:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536090.106310:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.106326:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788536090.106331:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536090.106338:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.106351:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.106360:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.106369:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.106410:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536090.107755:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536090.107766:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.107778:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839600 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536090.107782:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.107859:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.107878:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.107894:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8de52f9/0xe79af2f39bbdd9b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.107914:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.107916:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.107918:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788536090.108232:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536090.108239:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.108249:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1788536090.108254:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536090.108259:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.108269:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.108277:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.108284:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.108299:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788536090.111966:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536090.111984:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112001:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1788536090.112006:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536090.112012:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112028:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112039:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112047:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112079:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788536090.112429:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788536090.112437:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112446:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788536090.112450:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112460:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112480:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112495:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdd9c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112516:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536090.112519:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112526:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788536090.112529:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112537:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112547:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112555:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdd9c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.112566:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.112567:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.112569:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788536090.112659:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536090.112665:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112685:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1788536090.112689:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536090.112693:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112703:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112722:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112730:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.112747:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788536090.113001:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536090.113007:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.113020:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e600 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788536090.113023:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.113031:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.113042:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.113049:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdd9ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.113062:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.113064:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.113065:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788536090.113721:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536090.113731:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.113742:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1788536090.113745:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536090.113750:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.113761:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.113771:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.113778:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.113817:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788536090.113982:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536090.113988:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.113996:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632e200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788536090.114000:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.114008:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.114030:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.114039:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089c589c5/0xe79af2f39bbdd9d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.114057:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.114059:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.114060:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788536090.114934:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536090.114943:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.114955:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1788536090.114958:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536090.114963:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.114974:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.114983:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.114991:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.115048:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788536090.122992:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536090.123007:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.123020:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788536090.123025:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.123036:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.123057:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.123065:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000765892a2/0xe79af2f39bbdd9dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.123118:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.123120:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.123122:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.127886:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788536090.131385:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788536090.131400:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536090.131417:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=548s v=(0 0) 00010000:00010000:3.0:1788536090.131422:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536090.131428:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536090.131446:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536090.131457:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536090.131465:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536090.131490:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536090.131657:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536090.131665:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.131683:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536090.131702:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.131711:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.131728:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.131735:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa59bdd9/0xe79af2f39bbdd9e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.131753:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.131755:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.131757:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788536090.141323:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536090.141337:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.141353:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1788536090.141358:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536090.141364:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.141379:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.141390:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.141406:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.141427:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536090.141717:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.141725:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.141733:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632ee00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.141738:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.141748:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.141767:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.141775:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e01a9b8/0xe79af2f39bbdd9ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.141794:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.141796:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.141798:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788536090.142747:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788536090.142757:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.142769:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=548s v=(0 0) 00010000:00010000:1.0:1788536090.142773:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536090.142778:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.142790:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.142799:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.142807:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.142823:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536090.142993:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.142999:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.143018:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.143022:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.143031:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.143045:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.143071:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ebbe73b/0xe79af2f39bbdd9f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.143130:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.143133:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.143134:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536090.145011:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536090.145024:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145039:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788536090.145067:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536090.145073:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145086:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145105:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145113:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145265:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1788536090.145520:0:19525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788536090.145553:0:19525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788536090.145557:0:19525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788536090.145612:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536090.145618:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145628:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788536090.145631:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536090.145635:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145645:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145654:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145683:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145698:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788536090.145708:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536090.145714:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145721:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839800 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.145725:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145734:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145749:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145757:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6825d78/0xe79af2f39bbdd9f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145771:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.145775:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145791:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.145795:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145802:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145812:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145819:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dded9d43/0xe79af2f39bbdd9ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.145831:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.145833:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.145834:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.145961:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788536090.146414:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788536090.146422:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.146431:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788536090.146435:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536090.146439:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.146449:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.146465:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.146473:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.146490:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788536090.146632:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788536090.146638:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.146646:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788536090.146649:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.146657:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.146669:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.146686:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b466f1e7/0xe79af2f39bbdda06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.146701:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.146711:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.146712:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536090.147436:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17949:x1875415569467136:12345-0@lo:5:osp-pre-1-1.0 Request processed in 73586us (73640us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788536090.147457:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788536090.147548:0:17949:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788536090.147557:0:17949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875415569467136:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788536090.147571:0:17949:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788536090.147620:0:17949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17949:1875415569467264:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788536090.147658:0:17949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536090.147698:0:17949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004822db240 going to sleep for 11 seconds 00000100:00100000:2.0:1788536090.147749:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569467264 00000100:00100000:2.0:1788536090.147756:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569467264 00000100:00100000:2.0:1788536090.147799:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536090.147807:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17949:x1875415569467264:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788536090.147854:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17949:x1875415569467264:12345-0@lo:900:osp-pre-1-1.0 Request processed in 48us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536090.147861:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788536090.147892:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004888dd180 x1875415569467264/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788536106 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536090.147903:0:17949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17949:1875415569467264:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788536090.148697:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.148713:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.148726:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.148730:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.148736:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.148748:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.148757:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.148779:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.148799:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536090.149116:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.149123:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.149131:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.149135:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.149170:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.149200:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.149208:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.149226:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.149228:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.149231:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536090.149357:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.149363:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.149372:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.149375:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.149379:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.149389:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.149397:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.149404:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.149420:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536090.150025:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536090.150032:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.150047:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067a00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536090.150051:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.150059:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.150072:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.150080:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbdda14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.150096:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.150097:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.150099:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536090.150923:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.150933:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.150951:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.150955:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.150961:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.150972:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.150982:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.150989:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.151011:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536090.151202:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.151208:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.151216:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066c00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.151220:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.151228:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.151242:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.151249:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7f08213/0xe79af2f39bbdda1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.151276:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.151277:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.151279:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536090.151448:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.151454:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.151462:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.151465:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.151469:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.151477:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.151495:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.151502:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.153388:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788536090.154046:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.154056:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.154072:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.154076:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.154082:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.154094:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.154104:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.154112:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.157961:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536090.157974:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.157988:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.157993:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.158004:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.158025:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.158032:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002efb8263/0xe79af2f39bbdda22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.158058:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.158062:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.158069:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.158082:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.158090:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.158100:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.158108:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.158110:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.158112:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.159004:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788536090.159013:0:18711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000810f4cf6/0xe79af2f39bbdda29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788536090.159901:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.159911:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.159925:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.159930:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.159935:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.159947:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.159956:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.159963:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.166352:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536090.166367:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.166380:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536090.166385:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.166396:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.166428:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.166440:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.166442:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.166444:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.167967:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788536090.167980:0:18711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bc90aa6/0xe79af2f39bbdda30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788536090.168775:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.168784:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.168798:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.168802:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.168809:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.168821:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.168829:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.168837:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.168850:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536090.169504:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.169522:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.169533:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.169538:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.169548:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.169567:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.169574:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7de1d42/0xe79af2f39bbdda37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.169602:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.169603:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.169605:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536090.169627:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.169636:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.169645:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.169649:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.169661:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.169682:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.169692:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.169698:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.169717:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536090.169729:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.169736:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.169745:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e600 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.169749:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.169757:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.169769:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.169778:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b61352ce/0xe79af2f39bbdda3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788536090.170317:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.170324:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.170333:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.170337:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.170341:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.170351:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.170359:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.170378:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.170451:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.170454:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.170456:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788536090.170471:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788536090.170474:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536090.170480:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.170500:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536090.170504:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.170525:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.170538:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.170545:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085bac3e1/0xe79af2f39bbdda45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536090.170560:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.170562:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.170563:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536090.170889:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.170896:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.170905:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.170909:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.170913:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.170923:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.170931:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.170938:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.170957:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536090.171134:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536090.171141:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171169:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536090.171172:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171181:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171194:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171202:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098fed322/0xe79af2f39bbdda4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171218:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.171219:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.171221:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536090.171442:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536090.171669:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.171688:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.171704:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.171707:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.171712:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.171721:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.171730:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.171738:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.171759:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788536090.171860:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536090.171866:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171874:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3ec00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536090.171877:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171886:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171898:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171905:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaf4f903/0xe79af2f39bbdda53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.171919:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.171921:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.171922:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788536090.173114:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788536090.173126:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.173137:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=548s v=(0 0) 00010000:00010000:2.0:1788536090.173141:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536090.173160:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.173171:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.173193:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.173201:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536090.173214:0:18711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788536090.173268:0:18711:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1788536090.173364:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17231:x1875415569466624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 132951us (133249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536090.173375:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788536090.173392:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536090.173408:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.173416:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3f400 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536090.173420:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536090.173437:0:17231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17231:1875415569466624:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1788536090.173444:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788536090.173457:0:17231:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00010000:00010000:1.0:1788536090.173462:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.173471:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5cd67dd/0xe79af2f39bbdda5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536090.173492:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.173494:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536090.173496:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536090.173506:0:17231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb06680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17231:1875415569467392:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788536090.173553:0:17231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536090.173580:0:17231:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004823606c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788536090.173595:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569467392 00000100:00100000:2.0:1788536090.173601:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569467392 00000100:00100000:2.0:1788536090.173649:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788536090.173655:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17231:x1875415569467392:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788536090.173696:0:18711:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1788536090.180434:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17231:x1875415569467392:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6770us (6872us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788536090.180447:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788536090.180630:0:17231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb06680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17231:1875415569467392:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788536090.180647:0:17231:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1788536090.736174:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788536090.995229:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788536091.156087:0:19881:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788536091.758453:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536092.076418:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569467520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788536092.076487:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536092.076549:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569467520 00000100:00100000:1.0:1788536092.076557:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569467520 00000100:00100000:1.0:1788536092.076602:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788536092.076612:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569467520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788536092.076814:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788536092.076968:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569467520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788536092.077068:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569467520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 268us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536092.077091:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000020:00000004:0.0:1788536092.262254:0:19933:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788536092.262464:0:19933:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788536092.588360:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788536092.588384:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569467648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788536092.588393:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569467776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788536092.595368:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536092.595437:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569467648 00000100:00100000:0.0:1788536092.595446:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569467648 00000100:00100000:0.0:1788536092.595512:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788536092.595529:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569467648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788536092.595997:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788536092.596086:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569467648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 559us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536092.596093:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788536092.596114:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788536092.599066:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536092.600204:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569467648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788536092.603779:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569467776 00000100:00100000:0.0:1788536092.603804:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569467776 00000100:00100000:0.0:1788536092.603880:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788536092.603892:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569467776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788536092.603949:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788536092.604037:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569467776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (4979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536092.604045:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788536092.604107:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569467776:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788536092.780392:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788536093.299674:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788536093.456251:0:19983:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788536093.456497:0:19983:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788536093.808596:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536093.822753:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536093.822846:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548413056 00000100:00100000:1.0:1788536093.822856:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548413056 00000100:00100000:1.0:1788536093.822904:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1788536093.822913:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1875415548413056:12345-192.168.203.13@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788536093.822941:0:17198:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4a65ffba-b89a-415a-8707-2815433dfdf9@192.168.203.13@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1788536093.822972:0:17198:0:(genops.c:1385:class_connect()) connect: client 4a65ffba-b89a-415a-8707-2815433dfdf9, cookie 0xe79af2f39bbdda61 00000100:00080000:1.0:1788536093.823107:0:17198:0:(import.c:65:import_set_state_nolock()) ffff900488ac4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536093.823199:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+5:2398:x1875415548413056:12345-192.168.203.13@tcp:250:mount.lustre.0 Request processed in 285us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536093.823206:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:0.0:1788536093.832010:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.832131:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548413184 00000100:00100000:2.0:1788536093.832141:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548413184 00000100:00100000:2.0:1788536093.832266:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:2.0:1788536093.832278:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+5:14930:x1875415548413184:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788536093.832295:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536093.832316:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdda68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655729 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536093.832345:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdda68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655729 expref: 6 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536093.832357:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3e200/0xe79af2f39bbdda68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655729 expref: 6 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536093.832367:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3e200, rc 0) 00000100:00100000:2.0:1788536093.832483:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+6:14930:x1875415548413184:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 207us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.832490:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:0.0:1788536093.841547:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.842350:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548413312 00000100:00100000:2.0:1788536093.842362:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548413312 00000100:00100000:2.0:1788536093.842423:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1788536093.842432:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+6:14930:x1875415548413312:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788536093.842596:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+6:14930:x1875415548413312:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 164us (1058us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788536093.842604:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1788536093.845629:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.845697:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548413440 00000100:00100000:2.0:1788536093.845706:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548413440 00000100:00100000:2.0:1788536093.845855:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:2.0:1788536093.846190:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+6:14930:x1875415548413440:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788536093.846207:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536093.846226:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3f200/0xe79af2f39bbdda6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655730 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536093.846255:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3f200/0xe79af2f39bbdda6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655730 expref: 7 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536093.846266:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3f200/0xe79af2f39bbdda6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655730 expref: 7 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536093.846274:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3f200, rc 0) 00000100:00100000:2.0:1788536093.846381:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+7:14930:x1875415548413440:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 517us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.846388:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:0.0:1788536093.848207:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.848372:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548413568 00000100:00100000:2.0:1788536093.848378:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548413568 00000100:00100000:2.0:1788536093.848421:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:2.0:1788536093.848430:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+7:14930:x1875415548413568:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788536093.848583:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14930:x1875415548413568:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 153us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.848589:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:0.0:1788536093.852324:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.852394:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548413696 00000100:00100000:2.0:1788536093.852403:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548413696 00000100:00100000:2.0:1788536093.852496:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:2.0:1788536093.852504:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14930:x1875415548413696:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788536093.852615:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14930:x1875415548413696:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 112us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.852620:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:3.0:1788536093.858307:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.858463:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548413824 00000100:00100000:2.0:1788536093.858473:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548413824 00000100:00100000:2.0:1788536093.858533:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:2.0:1788536093.858543:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14948:x1875415548413824:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788536093.858796:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14948:x1875415548413824:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 254us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.858804:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:0.0:1788536093.929983:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.930437:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548413952 00000100:00100000:2.0:1788536093.930448:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548413952 00000100:00100000:2.0:1788536093.930506:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1788536093.930516:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14948:x1875415548413952:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788536093.930677:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14948:x1875415548413952:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 162us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.930686:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1788536093.942038:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.942414:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548414080 00000100:00100000:2.0:1788536093.942424:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548414080 00000100:00100000:2.0:1788536093.943513:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:2.0:1788536093.943529:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14948:x1875415548414080:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788536093.943689:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14948:x1875415548414080:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 164us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.943707:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:3.0:1788536093.954809:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.955130:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548414208 00000100:00100000:2.0:1788536093.955174:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548414208 00000100:00100000:2.0:1788536093.955237:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:2.0:1788536093.955247:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+8:14930:x1875415548414208:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788536093.955264:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536093.955281:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdda76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655761 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536093.955310:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdda76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655761 expref: 9 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536093.955321:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3fa00/0xe79af2f39bbdda76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655761 expref: 9 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536093.955329:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3fa00, rc 0) 00000100:00100000:2.0:1788536093.955388:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+9:14930:x1875415548414208:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 142us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.955395:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:0.0:1788536093.958748:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536093.959128:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548414336 00000100:00100000:1.0:1788536093.959139:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548414336 00000100:00100000:1.0:1788536093.959231:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:1.0:1788536093.959242:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+9:14930:x1875415548414336:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788536093.959268:0:17198:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788536093.959295:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788536093.959300:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788536093.959303:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788536093.959306:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788536093.959308:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788536093.961562:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+9:14930:x1875415548414336:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 2313us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536093.961576:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:3.0:1788536093.964922:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536093.965200:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548414464 00000100:00100000:0.0:1788536093.965209:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548414464 00000100:00100000:0.0:1788536093.965259:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:0.0:1788536093.965269:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+9:14930:x1875415548414464:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788536093.965285:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536093.965302:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655768 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536093.965331:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655768 expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536093.965342:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655768 expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536093.965352:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839400, rc 0) 00000100:00100000:0.0:1788536093.965411:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+10:14930:x1875415548414464:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 143us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536093.965418:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:1.0:1788536093.973338:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.973619:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548414592 00000100:00100000:2.0:1788536093.973630:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548414592 00000100:00100000:2.0:1788536093.973700:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1788536093.973721:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+10:14930:x1875415548414592:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788536093.974292:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+10:14930:x1875415548414592:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 579us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.974301:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1788536093.976287:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536093.976379:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548414720 00000100:00100000:1.0:1788536093.976389:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548414720 00000100:00100000:1.0:1788536093.976459:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:1.0:1788536093.976469:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+10:14930:x1875415548414720:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788536093.976618:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+10:14930:x1875415548414720:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 150us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536093.976626:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:3.0:1788536093.982255:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536093.982974:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548414848 00000100:00100000:2.0:1788536093.982985:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548414848 00000100:00100000:2.0:1788536093.983101:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:2.0:1788536093.983112:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+10:14955:x1875415548414848:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788536093.983305:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+10:14955:x1875415548414848:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 193us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536093.983313:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:2.0:1788536093.999342:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536093.999444:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548414976 00000100:00100000:0.0:1788536093.999455:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548414976 00000100:00100000:0.0:1788536093.999526:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:0.0:1788536093.999537:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+10:14955:x1875415548414976:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788536093.999769:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+10:14955:x1875415548414976:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 222us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536093.999777:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:3.0:1788536094.011434:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536094.011551:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536094.011785:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548415104 00000100:00100000:1.0:1788536094.011795:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548415104 00000100:00100000:1.0:1788536094.011834:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548415360 00000100:00100000:1.0:1788536094.011837:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548415360 00000100:00100000:1.0:1788536094.011853:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788536094.011862:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875415548415104:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788536094.011903:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b39ac8ea-251b-4f7c-a7f5-80db5502e4fc@192.168.203.13@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1788536094.011957:0:17204:0:(genops.c:1385:class_connect()) connect: client b39ac8ea-251b-4f7c-a7f5-80db5502e4fc, cookie 0xe79af2f39bbdda84 00000004:00100000:1.0:1788536094.011981:0:17204:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788536094.012252:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9005842b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536094.012319:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:2398:x1875415548415104:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 457us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536094.012327:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788536094.012347:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1788536094.012352:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875415548415360:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788536094.012370:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from b39ac8ea-251b-4f7c-a7f5-80db5502e4fc@192.168.203.13@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1788536094.012402:0:17204:0:(genops.c:1385:class_connect()) connect: client b39ac8ea-251b-4f7c-a7f5-80db5502e4fc, cookie 0xe79af2f39bbdda8b 00000004:00100000:1.0:1788536094.012415:0:17204:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788536094.012577:0:17204:0:(import.c:65:import_set_state_nolock()) ffff90059dc42800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536094.012604:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:2398:x1875415548415360:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 250us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536094.012617:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1788536094.021795:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536094.022067:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548415616 00000100:00100000:1.0:1788536094.022077:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548415616 00000100:00100000:1.0:1788536094.022198:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1788536094.022212:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:14930:x1875415548415616:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788536094.022256:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788536094.022355:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:14930:x1875415548415616:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 147us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536094.022362:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:0.0:1788536094.023069:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788536094.025334:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536094.025379:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536094.026188:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548415488 00000100:00100000:0.0:1788536094.026211:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548415488 00000100:00100000:3.0:1788536094.026247:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548415232 00000100:00100000:3.0:1788536094.026253:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548415232 00000100:00100000:0.0:1788536094.026296:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1788536094.026307:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:0:x1875415548415488:12345-192.168.203.13@tcp:41:mount.lustre.0 00000100:00080000:1.0:1788536094.026325:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1788536094.026346:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788536094.026442:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:0:x1875415548415488:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 136us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536094.026936:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536094.027088:0:17204:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788536094.027096:0:17204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788536094.027270:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548415744 00000100:00100000:3.0:1788536094.027276:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548415744 00000100:00100000:3.0:1788536094.027415:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788536094.027425:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:0:x1875415548415232:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788536094.027445:0:19995:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788536094.027504:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:0:x1875415548415232:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 80us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536094.027512:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788536094.027529:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788536094.027536:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:14930:x1875415548415744:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788536094.027566:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:14930:x1875415548415744:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 30us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536094.027572:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1788536094.028799:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1788536094.031474:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536094.031572:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536094.032752:0:19157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548415872 00000100:00100000:1.0:1788536094.032765:0:19157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548415872 00000100:00100000:1.0:1788536094.032993:0:19157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548416000 00000100:00100000:1.0:1788536094.032998:0:19157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548416000 00000100:00100000:3.0:1788536094.033068:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788536094.033076:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1875415548415872:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788536094.033186:0:18712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b39ac8ea-251b-4f7c-a7f5-80db5502e4fc@192.168.203.13@tcp t0 exp 0000000000000000 cur 552 last 0 00000100:00100000:1.0:1788536094.033186:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1788536094.033191:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875415548416000:12345-192.168.203.13@tcp:8:mount.lustre.0 00000020:00000080:2.0:1788536094.033216:0:18712:0:(genops.c:1385:class_connect()) connect: client b39ac8ea-251b-4f7c-a7f5-80db5502e4fc, cookie 0xe79af2f39bbdda92 00002000:00100000:2.0:1788536094.033228:0:18712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b39ac8ea-251b-4f7c-a7f5-80db5502e4fc/ffff900485dfa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788536094.033239:0:18712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:1.0:1788536094.033286:0:19157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b39ac8ea-251b-4f7c-a7f5-80db5502e4fc@192.168.203.13@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1788536094.033306:0:19157:0:(genops.c:1385:class_connect()) connect: client b39ac8ea-251b-4f7c-a7f5-80db5502e4fc, cookie 0xe79af2f39bbdda99 00002000:00100000:1.0:1788536094.033311:0:19157:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b39ac8ea-251b-4f7c-a7f5-80db5502e4fc/ffff90059dc45800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788536094.033323:0:19157:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788536094.033399:0:18712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788536094.033430:0:18712:0:(import.c:65:import_set_state_nolock()) ffff900485df8000 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1788536094.033474:0:19157:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788536094.033490:0:19157:0:(import.c:65:import_set_state_nolock()) ffff90059dc45000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536094.033544:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:2398:x1875415548416000:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 341us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536094.033553:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1788536094.033670:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536094.033749:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548416128 00000100:00100000:1.0:1788536094.033754:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548416128 00000100:00100000:1.0:1788536094.033904:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1788536094.033913:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:14930:x1875415548416128:12345-192.168.203.13@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788536094.033952:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:14930:x1875415548416128:12345-192.168.203.13@tcp:900:mount.lustre.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536094.033959:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788536094.034813:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:2398:x1875415548415872:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 1731us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536094.034823:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1788536094.044387:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536094.045407:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548416256 00000100:00100000:3.0:1788536094.045430:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548416256 00000100:00100000:3.0:1788536094.045773:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1788536094.045786:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:14930:x1875415548416256:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788536094.051259:0:17207:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5385us 00000004:00200000:0.0:1788536094.060354:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788536094.062186:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:14930:x1875415548416256:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 16390us (17795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536094.062209:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788536094.237954:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536094.238344:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548416384 00000100:00100000:3.0:1788536094.238355:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548416384 00000100:00100000:3.0:1788536094.238421:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788536094.238432:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:14978:x1875415548416384:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:3.0:1788536094.238453:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536094.238479:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbddaa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655799 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536094.238550:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbddaa7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536094.238564:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbddaa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536094.238578:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbddaa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536094.238622:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788536094.238625:0:17204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788536094.238671:0:17204:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbddaa7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536094.238697:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbddaa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655799 expref: 8 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536094.238714:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbddaa7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655799 expref: 7 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536094.238741:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936a00) 00010000:00010000:3.0:1788536094.238744:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788536094.238747:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50a00, rc 0) 00000100:00100000:3.0:1788536094.238825:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:14978:x1875415548416384:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 394us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536094.238831:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1788536094.638163:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788536094.638188:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569467904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788536094.638261:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536094.638522:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569467904 00000100:00100000:3.0:1788536094.638531:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569467904 00000100:00100000:3.0:1788536094.638598:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788536094.638607:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569467904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788536094.638634:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788536094.638694:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569467904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536094.638701:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788536094.638763:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788536094.638810:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569467904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788536094.828487:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536095.148899:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569468160:0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.148989:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536095.149040:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788536095.149046:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569468032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788536095.149078:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536095.149090:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569468288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788536095.149128:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536095.149169:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569468032 00000100:00100000:2.0:1788536095.149178:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569468032 00000100:00100000:1.0:1788536095.149200:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569468288 00000100:00100000:1.0:1788536095.149205:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569468288 00000100:00100000:3.0:1788536095.149413:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569468672:0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.149441:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536095.149458:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569469184:0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.149477:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536095.149501:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788536095.149506:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569468544:0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.149523:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536095.150049:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569469056:0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.150093:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536095.150137:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569468416:0@lo:400:kworker.0 00000100:00100000:1.0:1788536095.150179:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788536095.150211:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536095.150227:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569468928:0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.150241:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536095.150249:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569469440:0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.150259:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536095.150268:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788536095.150271:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569468800:0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.150294:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536095.150307:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569469312:0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.150319:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536095.150344:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569469184 00000100:00100000:3.0:1788536095.150348:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569469184 00000100:00100000:1.0:1788536095.150379:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569468288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788536095.150403:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788536095.150450:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875415569468288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 261us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536095.150456:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788536095.150496:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569468672 00000100:00100000:1.0:1788536095.150500:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569468672 00000100:00100000:1.0:1788536095.150524:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569468416 00000100:00100000:1.0:1788536095.150527:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569468416 00000100:00100000:1.0:1788536095.150539:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788536095.150544:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569468672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536095.150583:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569468672:12345-0@lo:400:kworker.0 Request processed in 38us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536095.150593:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788536095.150604:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788536095.150610:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569468416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536095.150660:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569468416:12345-0@lo:400:kworker.0 Request processed in 51us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536095.150666:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788536095.150685:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569468544 00000100:00100000:1.0:1788536095.150688:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569468544 00000100:00100000:1.0:1788536095.150704:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569469056 00000100:00100000:1.0:1788536095.150706:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569469056 00000100:00100000:3.0:1788536095.151393:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569468928 00000100:00100000:2.0:1788536095.151397:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788536095.151399:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569468928 00000100:00100000:2.0:1788536095.151411:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569468032:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788536095.151419:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569469440 00000100:00100000:3.0:1788536095.151423:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569469440 00002000:00000024:2.0:1788536095.151426:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788536095.151440:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569469312 00000100:00100000:3.0:1788536095.151444:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569469312 00000100:00100000:3.0:1788536095.151463:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788536095.151473:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569468544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.151478:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569468032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536095.151486:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788536095.151515:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569468160 00000100:00100000:3.0:1788536095.151519:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875415569468544:12345-0@lo:400:kworker.0 Request processed in 46us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536095.151521:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569468160 00000100:00100000:3.0:1788536095.151529:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788536095.151547:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788536095.151556:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569469184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.151561:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788536095.151572:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:3660:x1875415569468160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.151591:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875415569469184:12345-0@lo:400:kworker.0 Request processed in 37us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536095.151612:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788536095.151612:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:3660:x1875415569468160:12345-0@lo:400:kworker.0 Request processed in 41us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536095.151623:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788536095.151630:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788536095.151650:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569468928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.151687:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569468928:12345-0@lo:400:kworker.0 Request processed in 50us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536095.151725:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569468032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788536095.151738:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569468160:0@lo:400:kworker.0 00000100:00080000:2.0:1788536095.151785:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788536095.151789:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788536095.151791:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788536095.151814:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569468288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788536095.151843:0:19157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569468800 00000100:00100000:3.0:1788536095.151849:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788536095.151856:0:19157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569468800 00000100:00080000:3.0:1788536095.151889:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788536095.151905:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788536095.151912:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569468800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536095.151933:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788536095.151943:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569469440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.151950:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569468800:12345-0@lo:400:kworker.0 Request processed in 37us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536095.152030:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788536095.152033:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569469440:12345-0@lo:400:kworker.0 Request processed in 92us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536095.152041:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788536095.152090:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875415569468544:0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.152104:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788536095.152106:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569468672:0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.152117:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569469312:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788536095.152123:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488870380 x1875415569469184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536095.152135:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3661:1875415569469184:0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.152184:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569469312:12345-0@lo:400:kworker.0 Request processed in 71us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536095.152191:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788536095.152243:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569468800:0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.152259:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569469312:0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.152269:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90048891c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569468416:0@lo:400:kworker.0 00000100:00100000:2.0:1788536095.152279:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569468928:0@lo:400:kworker.0 00010000:00080000:2.0:1788536095.152289:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488873480 x1875415569469440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536095.152298:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569469440:0@lo:400:kworker.0 00000100:00100000:1.0:1788536095.156140:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788536095.156176:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569469056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536095.156405:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875415569469056:12345-0@lo:400:kworker.0 Request processed in 236us (6309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536095.156412:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788536095.159243:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3661:1875415569469056:0@lo:400:kworker.0 00010000:00010000:1.0:1788536095.853053:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788536096.175906:0:19525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b39ac8ea-251b-4f7c-a7f5-80db5502e4fc 00000001:00080000:0.0:1788536096.175926:0:19525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1788536096.367757:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536096.367896:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548416512 00000100:00100000:0.0:1788536096.367907:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548416512 00000100:00080000:3.0:1788536096.367968:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788536096.367985:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:0.0:1788536096.367995:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:15030:x1875415548416512:12345-192.168.203.13@tcp:41:lfs.0 00000004:00000024:0.0:1788536096.368045:0:19995:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788536096.368136:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:15030:x1875415548416512:12345-192.168.203.13@tcp:41:lfs.0 Request processed in 142us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536096.368143:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1788536096.371364:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.380048:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548416640 00000100:00100000:2.0:1788536096.380062:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548416640 00000100:00100000:2.0:1788536096.380173:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1788536096.380185:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:15030:x1875415548416640:12345-192.168.203.13@tcp:41:lfs.0 00000004:00000024:2.0:1788536096.380223:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788536096.380374:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:15030:x1875415548416640:12345-192.168.203.13@tcp:41:lfs.0 Request processed in 191us (9018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.380394:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00080000:3.0:1788536096.381806:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788536096.392095:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.392426:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548416768 00000100:00100000:2.0:1788536096.392436:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548416768 00000100:00100000:2.0:1788536096.392511:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1788536096.392521:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:15030:x1875415548416768:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:2.0:1788536096.392553:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788536096.392643:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788536096.392644:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:15030:x1875415548416768:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 123us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.392653:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1788536096.398762:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.399913:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548416896 00000100:00100000:2.0:1788536096.399926:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548416896 00000100:00100000:2.0:1788536096.400628:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1788536096.400656:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:15030:x1875415548416896:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:2.0:1788536096.400691:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788536096.400888:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:15030:x1875415548416896:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 234us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.400896:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00080000:3.0:1788536096.404022:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788536096.577426:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536096.577556:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548417024 00000100:00100000:1.0:1788536096.577568:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548417024 00000100:00100000:1.0:1788536096.577642:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:1.0:1788536096.577652:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+10:15059:x1875415548417024:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788536096.577673:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536096.577692:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632ee00/0xe79af2f39bbddaae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b16557a0 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536096.577720:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632ee00/0xe79af2f39bbddaae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557a0 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536096.577732:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632ee00/0xe79af2f39bbddaae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557a0 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536096.577741:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632ee00, rc 0) 00000100:00100000:1.0:1788536096.577800:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15059:x1875415548417024:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 150us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536096.577807:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:0.0:1788536096.583323:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.583416:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548417152 00000100:00100000:2.0:1788536096.583426:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548417152 00000100:00100000:2.0:1788536096.583485:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:2.0:1788536096.583495:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15059:x1875415548417152:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788536096.583686:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15059:x1875415548417152:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 192us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.583702:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:3.0:1788536096.590360:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.592639:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548417280 00000100:00100000:2.0:1788536096.592669:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548417280 00000100:00100000:2.0:1788536096.593299:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:2.0:1788536096.593312:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15059:x1875415548417280:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788536096.593461:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15059:x1875415548417280:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 152us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.593469:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:0.0:1788536096.600601:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536096.600691:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548417408 00000100:00100000:1.0:1788536096.600700:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548417408 00000100:00100000:1.0:1788536096.600764:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:1.0:1788536096.600773:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15066:x1875415548417408:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788536096.600919:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15066:x1875415548417408:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 147us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536096.600926:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:1.0:1788536096.648525:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.648825:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548417536 00000100:00100000:2.0:1788536096.648835:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548417536 00000100:00100000:2.0:1788536096.648892:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:2.0:1788536096.648903:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15066:x1875415548417536:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788536096.649623:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15066:x1875415548417536:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 719us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.649641:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:3.0:1788536096.668263:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536096.668877:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548417664 00000100:00100000:0.0:1788536096.668886:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548417664 00000100:00100000:0.0:1788536096.669062:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:0.0:1788536096.669072:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ac84f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15066:x1875415548417664:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788536096.669276:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ac84f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15066:x1875415548417664:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 204us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536096.669285:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:0.0:1788536096.680216:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.680516:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548417792 00000100:00100000:2.0:1788536096.680526:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548417792 00000100:00100000:2.0:1788536096.680570:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:2.0:1788536096.680578:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+11:15059:x1875415548417792:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788536096.680595:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536096.680611:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3e000/0xe79af2f39bbddab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b16557d1 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536096.680649:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3e000/0xe79af2f39bbddab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d1 expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536096.680661:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3e000/0xe79af2f39bbddab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d1 expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536096.680686:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3e000, rc 0) 00000100:00100000:2.0:1788536096.680750:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+12:15059:x1875415548417792:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 172us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.680758:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:2.0:1788536096.690133:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536096.690207:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548417920 00000100:00100000:0.0:1788536096.690218:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548417920 00000100:00100000:0.0:1788536096.690277:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:0.0:1788536096.690287:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+12:15059:x1875415548417920:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788536096.690312:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788536096.690336:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788536096.690340:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788536096.690343:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788536096.690346:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788536096.690348:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788536096.694349:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+12:15059:x1875415548417920:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 4051us (4215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536096.694365:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:1.0:1788536096.708283:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536096.712830:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548418048 00000100:00100000:0.0:1788536096.712845:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548418048 00000100:00100000:1.0:1788536096.713715:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:1.0:1788536096.713728:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+12:15059:x1875415548418048:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788536096.713804:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536096.713824:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b16557d8 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536096.713851:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d8 expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536096.713863:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d8 expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536096.713872:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632f800, rc 0) 00000100:00100000:1.0:1788536096.714065:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+13:15059:x1875415548418048:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 338us (5977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536096.714072:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:2.0:1788536096.720428:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536096.720841:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548418176 00000100:00100000:0.0:1788536096.720851:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548418176 00000100:00100000:0.0:1788536096.720916:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:0.0:1788536096.720927:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+13:15059:x1875415548418176:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788536096.721679:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+13:15059:x1875415548418176:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 751us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536096.721709:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:1.0:1788536096.734708:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.734921:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548418304 00000100:00100000:2.0:1788536096.734933:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548418304 00000100:00100000:2.0:1788536096.735039:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:2.0:1788536096.735050:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+13:15059:x1875415548418304:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788536096.735226:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+13:15059:x1875415548418304:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 177us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.735232:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:1.0:1788536096.740806:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536096.741189:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548418432 00000100:00100000:0.0:1788536096.741200:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548418432 00000100:00100000:0.0:1788536096.741259:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:0.0:1788536096.741269:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+13:15076:x1875415548418432:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788536096.741408:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+13:15076:x1875415548418432:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 139us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536096.741415:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:1.0:1788536096.746506:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.748492:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548418560 00000100:00100000:2.0:1788536096.748505:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548418560 00000100:00100000:2.0:1788536096.748566:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:2.0:1788536096.748576:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+13:15076:x1875415548418560:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788536096.748741:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+13:15076:x1875415548418560:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 166us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.748750:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:1.0:1788536096.756257:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536096.756322:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548418688 00000100:00100000:0.0:1788536096.756333:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548418688 00000100:00100000:1.0:1788536096.756339:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536096.756591:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548418944 00000100:00100000:0.0:1788536096.756596:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548418944 00000100:00100000:3.0:1788536096.760320:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1788536096.760333:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900487ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1875415548418688:12345-192.168.203.13@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788536096.762169:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1788536096.762178:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1875415548418944:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788536096.762208:0:19995:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 38196aad-db5b-40a4-908a-ec1a96ba5904@192.168.203.13@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:0.0:1788536096.762242:0:19995:0:(genops.c:1385:class_connect()) connect: client 38196aad-db5b-40a4-908a-ec1a96ba5904, cookie 0xe79af2f39bbddac3 00000004:00100000:0.0:1788536096.762264:0:19995:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788536096.762350:0:19995:0:(import.c:65:import_set_state_nolock()) ffff90048228a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788536096.762413:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38196aad-db5b-40a4-908a-ec1a96ba5904+6:2398:x1875415548418944:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 235us (6076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536096.762420:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00010000:00080000:1.0:1788536096.765369:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 38196aad-db5b-40a4-908a-ec1a96ba5904@192.168.203.13@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:1.0:1788536096.765421:0:17205:0:(genops.c:1385:class_connect()) connect: client 38196aad-db5b-40a4-908a-ec1a96ba5904, cookie 0xe79af2f39bbddaca 00000004:00100000:1.0:1788536096.765453:0:17205:0:(mdt_handler.c:7337:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788536096.765560:0:17205:0:(import.c:65:import_set_state_nolock()) ffff90059dc41000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788536096.765641:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900487ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+6:2398:x1875415548418688:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 5308us (9391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536096.765669:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1788536096.767111:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536096.767443:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536096.767506:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536096.767699:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548419072 00000100:00100000:3.0:1788536096.767709:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548419072 00000100:00100000:3.0:1788536096.767778:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548418816 00000100:00100000:3.0:1788536096.767782:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548418816 00000100:00100000:3.0:1788536096.767796:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548419200 00000100:00100000:3.0:1788536096.767798:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548419200 00000100:00100000:3.0:1788536096.767812:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788536096.767821:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+6:0:x1875415548419072:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788536096.767850:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788536096.767923:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+6:0:x1875415548419072:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 102us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536096.767929:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788536096.767946:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788536096.767953:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+7:0:x1875415548418816:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788536096.767964:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788536096.767989:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+7:0:x1875415548418816:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 37us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536096.767995:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1788536096.768007:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1788536096.768013:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15059:x1875415548419200:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788536096.768024:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788536096.768043:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15059:x1875415548419200:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536096.768064:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00080000:1.0:1788536096.769273:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788536096.769280:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788536096.771925:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536096.774851:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548419328 00000100:00100000:3.0:1788536096.774865:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548419328 00000100:00100000:3.0:1788536096.774935:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1788536096.774945:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004888ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15059:x1875415548419328:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788536096.775040:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004888ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15059:x1875415548419328:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 96us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536096.775049:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788536096.778435:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.778473:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536096.778556:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548419456 00000100:00100000:3.0:1788536096.778565:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548419456 00000100:00100000:2.0:1788536096.778571:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536096.778598:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548419584 00000100:00100000:3.0:1788536096.778601:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548419584 00000100:00100000:3.0:1788536096.778619:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1788536096.778638:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1875415548419456:12345-192.168.203.13@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788536096.778649:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1788536096.778666:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875415548419584:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788536096.778688:0:19157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 38196aad-db5b-40a4-908a-ec1a96ba5904@192.168.203.13@tcp t0 exp 0000000000000000 cur 555 last 0 00010000:00080000:3.0:1788536096.778716:0:18712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 38196aad-db5b-40a4-908a-ec1a96ba5904@192.168.203.13@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:2.0:1788536096.778719:0:19157:0:(genops.c:1385:class_connect()) connect: client 38196aad-db5b-40a4-908a-ec1a96ba5904, cookie 0xe79af2f39bbddad1 00002000:00100000:2.0:1788536096.778732:0:19157:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 38196aad-db5b-40a4-908a-ec1a96ba5904/ffff900485dfb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788536096.778742:0:19157:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:00000080:3.0:1788536096.778778:0:18712:0:(genops.c:1385:class_connect()) connect: client 38196aad-db5b-40a4-908a-ec1a96ba5904, cookie 0xe79af2f39bbddad8 00002000:00100000:3.0:1788536096.778784:0:18712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 38196aad-db5b-40a4-908a-ec1a96ba5904/ffff900486a09000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788536096.778790:0:18712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788536096.778830:0:19157:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:3.0:1788536096.778841:0:18712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788536096.778861:0:19157:0:(import.c:65:import_set_state_nolock()) ffff900485dfc000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788536096.778863:0:18712:0:(import.c:65:import_set_state_nolock()) ffff900486a0c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788536096.778989:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38196aad-db5b-40a4-908a-ec1a96ba5904+6:2398:x1875415548419584:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 322us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.778997:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1788536096.779138:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+6:2398:x1875415548419456:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 511us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536096.779142:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1788536096.779305:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548419712 00000100:00100000:1.0:1788536096.779313:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548419712 00000100:00100000:1.0:1788536096.779363:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1788536096.779370:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15059:x1875415548419712:12345-192.168.203.13@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788536096.779403:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15059:x1875415548419712:12345-192.168.203.13@tcp:900:mount.lustre.0 Request processed in 34us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536096.779415:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1788536096.785746:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536096.785944:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548419840 00000100:00100000:1.0:1788536096.785954:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548419840 00000100:00100000:1.0:1788536096.786007:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1788536096.786016:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15059:x1875415548419840:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788536096.786108:0:17208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788536096.786211:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15059:x1875415548419840:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 195us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536096.786218:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00010000:00010000:1.0:1788536096.878165:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536096.941535:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536096.941650:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548419968 00000100:00100000:2.0:1788536096.941659:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548419968 00000100:00100000:2.0:1788536096.941726:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788536096.941736:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15099:x1875415548419968:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:2.0:1788536096.941755:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536096.941778:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddadf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655809 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536096.941837:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536096.941852:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536096.941864:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536096.941934:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788536096.941938:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788536096.941957:0:17206:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536096.941980:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddadf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655809 expref: 8 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536096.941997:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655809 expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536096.942016:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936a00) 00010000:00010000:2.0:1788536096.942019:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788536096.942022:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3e600, rc 0) 00000100:00100000:2.0:1788536096.942078:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+7:15099:x1875415548419968:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 344us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536096.942085:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1788536097.196857:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569469568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788536097.197072:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536097.197186:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569469568 00000100:00100000:1.0:1788536097.197195:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569469568 00000100:00100000:1.0:1788536097.197259:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788536097.197270:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569469568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788536097.197317:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788536097.204733:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569469568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7452us (7649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536097.204749:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788536097.210039:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569469568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788536097.708476:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569469696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788536097.708548:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536097.708645:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569469696 00000100:00100000:1.0:1788536097.708654:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569469696 00000100:00100000:1.0:1788536097.708711:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788536097.708721:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569469696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788536097.708770:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788536097.708828:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569469696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536097.708834:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788536097.709037:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569469696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788536097.710176:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569469824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788536097.710228:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536097.710315:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569469824 00000100:00100000:3.0:1788536097.710321:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569469824 00000100:00100000:3.0:1788536097.710380:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788536097.710389:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569469824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788536097.710407:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788536097.710430:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788536097.710457:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569469824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536097.710464:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788536097.710493:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569469824:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788536097.900438:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536098.924539:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536099.758241:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788536099.758275:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569469952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788536099.758351:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536099.758424:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569469952 00000100:00100000:0.0:1788536099.758431:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569469952 00000100:00100000:0.0:1788536099.758588:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788536099.758596:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569469952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788536099.758636:0:18714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788536099.758684:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569469952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536099.758691:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788536099.758711:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788536099.758750:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569469952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788536099.962503:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788536100.131447:0:20082:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1788536100.205625:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788536100.274315:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569470080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788536100.274398:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536100.282427:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788536100.282447:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569470208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788536100.282511:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536100.284963:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569470080 00000100:00100000:1.0:1788536100.284979:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569470080 00000100:00100000:1.0:1788536100.285036:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569470208 00000100:00100000:1.0:1788536100.285040:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569470208 00000100:00100000:1.0:1788536100.285062:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788536100.285071:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569470080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788536100.285114:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788536100.285201:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569470080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (10803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536100.285208:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788536100.285223:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788536100.285230:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569470208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788536100.285252:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788536100.285276:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569470208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (2765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536100.285282:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788536100.285408:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788536100.285457:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569470208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788536100.285471:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788536100.285494:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569470080:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788536100.291733:0:18707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 38196aad-db5b-40a4-908a-ec1a96ba5904 00000001:00100000:1.0:1788536100.291752:0:18707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b39ac8ea-251b-4f7c-a7f5-80db5502e4fc 00000100:00100000:3.0:1788536100.293589:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569470336:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.295950:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.296031:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569470848:0@lo:400:kworker.0 00000100:00100000:1.0:1788536100.296215:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569470336 00000100:00100000:1.0:1788536100.296225:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569470336 00000100:00100000:1.0:1788536100.296276:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788536100.296285:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:3662:x1875415569470336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536100.296336:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:3662:x1875415569470336:12345-0@lo:400:kworker.0 Request processed in 52us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536100.296343:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788536100.296436:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.296467:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569471360:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.296496:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.296550:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569470336:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.296567:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788536100.296574:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569470464:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.296597:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.297273:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569470976:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.297320:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.297340:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569471488:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.297359:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.297391:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569470592:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.297410:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.297434:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569471104:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.297452:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.297466:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569471616:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.297484:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.297503:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788536100.297509:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569470720:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.297527:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.297536:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569471232:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.297552:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536100.297573:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569471360 00000100:00100000:3.0:1788536100.297580:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569471360 00000100:00100000:3.0:1788536100.297631:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569471488 00000100:00100000:3.0:1788536100.297634:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569471488 00000100:00100000:3.0:1788536100.297648:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569471104 00000100:00100000:3.0:1788536100.297650:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569471104 00000100:00100000:3.0:1788536100.297660:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569471616 00000100:00100000:3.0:1788536100.297662:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569471616 00000100:00100000:3.0:1788536100.297671:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569470720 00000100:00100000:3.0:1788536100.297673:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569470720 00000100:00100000:3.0:1788536100.297683:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569471232 00000100:00100000:3.0:1788536100.297685:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569471232 00000100:00100000:3.0:1788536100.297732:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788536100.297740:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569471360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.300167:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875415569471360:12345-0@lo:400:kworker.0 Request processed in 2425us (3666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536100.300179:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788536100.300228:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788536100.300240:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569471488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.300287:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875415569471488:12345-0@lo:400:kworker.0 Request processed in 52us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536100.300294:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788536100.300503:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788536100.300511:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569471104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.300551:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875415569471104:12345-0@lo:400:kworker.0 Request processed in 42us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536100.300558:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788536100.300571:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788536100.300578:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569471616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.301823:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875415569471616:12345-0@lo:400:kworker.0 Request processed in 1128us (4220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536100.301836:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788536100.301862:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788536100.301873:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569470720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.301953:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875415569470720:12345-0@lo:400:kworker.0 Request processed in 85us (4424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536100.301960:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788536100.301974:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788536100.301981:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569471232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.302011:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569471232:12345-0@lo:400:kworker.0 Request processed in 31us (4457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536100.302016:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788536100.308265:0:19157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569470976 00000100:00100000:2.0:1788536100.308283:0:19157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569470976 00000100:00100000:2.0:1788536100.308385:0:19157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569470592 00000100:00100000:2.0:1788536100.308390:0:19157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569470592 00000100:00100000:2.0:1788536100.308417:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788536100.308427:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569470976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536100.308533:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569470976:12345-0@lo:400:kworker.0 Request processed in 108us (11211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536100.308541:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788536100.308560:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788536100.308567:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90048891ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569470592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536100.308597:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90048891ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569470592:12345-0@lo:400:kworker.0 Request processed in 31us (11185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536100.308613:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788536100.308958:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569470848 00000100:00100000:1.0:1788536100.308964:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569470848 00000100:00100000:1.0:1788536100.309083:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569470464 00000100:00100000:1.0:1788536100.309097:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569470464 00000100:00100000:1.0:1788536100.309114:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788536100.309121:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569470848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536100.309197:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569470848:12345-0@lo:400:kworker.0 Request processed in 77us (12761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536100.309204:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788536100.309244:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788536100.309249:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569470464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788536100.309281:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569470464:12345-0@lo:400:kworker.0 Request processed in 32us (12683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536100.309286:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788536100.310318:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788536100.310327:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788536100.310330:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1788536100.310363:0:17184:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 38196aad-db5b-40a4-908a-ec1a96ba5904 00000001:00100000:2.0:1788536100.310372:0:17184:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b39ac8ea-251b-4f7c-a7f5-80db5502e4fc 00000001:00100000:1.0:1788536100.310903:0:17937:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 38196aad-db5b-40a4-908a-ec1a96ba5904 00000001:00100000:1.0:1788536100.310910:0:17937:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b39ac8ea-251b-4f7c-a7f5-80db5502e4fc 00000100:00100000:3.0:1788536100.311915:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569470464:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.311943:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569470976:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.311954:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3662:1875415569471488:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.311969:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569470848:0@lo:400:kworker.0 00010000:00080000:3.0:1788536100.311984:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fb7e300 x1875415569471360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536100.311996:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3662:1875415569471360:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.312047:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875415569470720:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.312057:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569471232:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.312068:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569470592:0@lo:400:kworker.0 00000100:00100000:3.0:1788536100.312078:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875415569471104:0@lo:400:kworker.0 00010000:00080000:3.0:1788536100.312089:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff900488873480 x1875415569471616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788536100.312939:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3660:1875415569471616:0@lo:400:kworker.0 00010000:00010000:1.0:1788536100.972444:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536102.001290:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536102.268350:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536102.268392:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536102.268427:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536102.268458:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536102.268511:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536102.268530:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536102.268547:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536102.268566:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536102.268603:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536102.268635:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548420480 00000100:00100000:2.0:1788536102.268644:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548420480 00000100:00100000:2.0:1788536102.268694:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548420992 00000100:00100000:2.0:1788536102.268697:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548420992 00000100:00100000:2.0:1788536102.268723:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548420608 00000100:00100000:2.0:1788536102.268726:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548420608 00000100:00100000:2.0:1788536102.268742:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548421120 00000100:00100000:2.0:1788536102.268745:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548421120 00000100:00100000:2.0:1788536102.268762:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788536102.268772:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2402:x1875415548420480:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1788536102.268902:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2402:x1875415548420480:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 131us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536102.269077:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548420224 00000100:00100000:1.0:1788536102.269081:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548420224 00000100:00100000:1.0:1788536102.269108:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548420736 00000100:00100000:1.0:1788536102.269111:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548420736 00000100:00100000:1.0:1788536102.269123:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548420352 00000100:00100000:1.0:1788536102.269126:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548420352 00000100:00100000:1.0:1788536102.269137:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548420864 00000100:00100000:1.0:1788536102.269140:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548420864 00000100:00100000:1.0:1788536102.269184:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1788536102.269191:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:2402:x1875415548420224:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788536102.269224:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:2402:x1875415548420224:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536102.269231:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1788536102.269248:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1788536102.269254:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+6:2402:x1875415548420736:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788536102.269275:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+6:2402:x1875415548420736:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 21us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536102.269280:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1788536102.269290:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1788536102.269306:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2402:x1875415548420352:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788536102.269330:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2402:x1875415548420352:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536102.269336:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1788536102.269348:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1788536102.269355:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2402:x1875415548420864:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788536102.269376:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2402:x1875415548420864:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536102.269382:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1788536102.269454:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788536102.272184:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548420096 00000100:00100000:1.0:1788536102.272199:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548420096 00000100:00100000:1.0:1788536102.272271:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:1.0:1788536102.272282:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+13:2402:x1875415548420096:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788536102.272345:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+13:2402:x1875415548420096:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 66us (3833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536102.272353:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00080000:1.0:1788536102.274658:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788536102.274669:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788536102.274673:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788536102.274676:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788536102.274777:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788536102.274800:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2402:x1875415548420992:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788536102.274873:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2402:x1875415548420992:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 86us (6414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536102.274881:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1788536102.274906:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788536102.274927:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2402:x1875415548420608:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788536102.274953:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2402:x1875415548420608:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 41us (6405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536102.274959:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788536102.274988:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788536102.274995:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38196aad-db5b-40a4-908a-ec1a96ba5904+6:2402:x1875415548421120:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1788536102.275017:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38196aad-db5b-40a4-908a-ec1a96ba5904+6:2402:x1875415548421120:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (6414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536102.275023:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1788536102.316279:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569471744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788536102.316345:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536102.316619:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569471744 00000100:00100000:1.0:1788536102.316628:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569471744 00000100:00100000:1.0:1788536102.316678:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788536102.316687:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569471744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788536102.316720:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788536102.316774:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569471744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536102.316788:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788536102.316804:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569471744:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788536102.317897:0:19525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38196aad-db5b-40a4-908a-ec1a96ba5904 00000100:00100000:1.0:1788536102.828369:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788536102.828392:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569471872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788536102.828457:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536102.828559:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569471872 00000100:00100000:3.0:1788536102.828567:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569471872 00000100:00100000:3.0:1788536102.828626:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788536102.828635:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569471872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788536102.828676:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788536102.828734:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569471872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536102.828741:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788536102.828807:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569471872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788536102.833038:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569472000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788536102.833119:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536102.833317:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569472000 00000100:00100000:0.0:1788536102.833327:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569472000 00000100:00100000:2.0:1788536102.838060:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788536102.838077:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569472000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788536102.838113:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788536102.838228:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569472000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (5108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536102.838235:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788536102.838463:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788536102.838511:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569472000:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788536103.020345:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788536103.533743:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1788536103.776714:0:20230:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd37f99690 20000000:00000080:1.0:1788536103.776731:0:20230:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90059dc4c800 uarg=0000000000000000 20000000:01000000:1.0:1788536103.776773:0:20230:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788536103.776778:0:20230:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788536103.776783:0:20230:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788536103.780569:0:20231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788536103.780831:0:20230:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788536103.787023:0:20230:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788536103.787055:0:20230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787074:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd77b expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787083:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd789 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787089:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd7c8 expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787115:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbdd911 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787125:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655768 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787132:0:20230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d8 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787139:0:20230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787339:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d8 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787355:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d8 expref: 12 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.787369:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472128:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788536103.787476:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655768 expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787485:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655768 expref: 12 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.787492:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472256:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788536103.787522:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd911 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787541:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd911 expref: 23 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.787550:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488964e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472384:0@lo:104: 00000100:00100000:1.0:1788536103.787601:0:20230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788536103.787644:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd7c8 expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787652:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd7c8 expref: 23 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.787660:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488967100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472512:0@lo:104: 00000100:00100000:1.0:1788536103.787682:0:20230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788536103.787711:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd789 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787719:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd789 expref: 23 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.787727:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488967800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472640:0@lo:104: 00000100:00100000:1.0:1788536103.787746:0:20230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788536103.787762:0:20230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe79af2f39bbdd77b expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.787770:0:20230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe79af2f39bbdd77b expref: 23 pid: 17197 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.787778:0:20230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488965880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472768:0@lo:104: 00000100:00100000:1.0:1788536103.787808:0:20230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536103.787819:0:20230:0:(client.c:2716:ptlrpc_set_wait()) set ffff90058508a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788536103.787889:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569472384 00000100:00100000:0.0:1788536103.787896:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569472384 00000100:00100000:0.0:1788536103.787946:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569472512 00000100:00100000:0.0:1788536103.787950:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569472512 00000100:00100000:0.0:1788536103.787959:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569472640 00000100:00100000:0.0:1788536103.787962:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569472640 00000100:00100000:0.0:1788536103.787970:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569472768 00000100:00100000:0.0:1788536103.787971:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569472768 00000100:00100000:0.0:1788536103.787983:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788536103.787990:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+6:20230:x1875415569472384:12345-0@lo:104: 00010000:00010000:0.0:1788536103.788003:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788066:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788536103.788072:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+6:20230:x1875415569472384:12345-0@lo:104: Request processed in 83us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536103.788079:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788536103.788096:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536103.788102:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+5:20230:x1875415569472512:12345-0@lo:104: 00010000:00010000:0.0:1788536103.788117:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788174:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788536103.788180:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+5:20230:x1875415569472512:12345-0@lo:104: Request processed in 78us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536103.788187:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536103.788200:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788536103.788206:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+4:20230:x1875415569472640:12345-0@lo:104: 00010000:00010000:0.0:1788536103.788214:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788246:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788536103.788251:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+4:20230:x1875415569472640:12345-0@lo:104: Request processed in 46us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536103.788257:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788536103.788268:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788536103.788274:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+3:20230:x1875415569472768:12345-0@lo:104: 00010000:00010000:0.0:1788536103.788281:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788304:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788536103.788309:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25821a76-2177-4c11-bd6b-eb660028a815+3:20230:x1875415569472768:12345-0@lo:104: Request processed in 37us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536103.788316:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788536103.788335:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788536103.788340:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788353:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f200 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788536103.788357:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788365:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788536103.788372:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536103.788378:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788536103.788406:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788413:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788536103.788430:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788437:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059620f200/0xe79af2f39bbdd911 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd934 expref: -99 pid: 19524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788451:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788536103.788454:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788459:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e800 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788536103.788462:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788479:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788536103.788486:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536103.788490:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788536103.788506:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788512:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788536103.788519:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788526:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059620e800/0xe79af2f39bbdd7c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd7cf expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788535:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788536103.788538:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788544:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f600 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788536103.788547:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788554:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788536103.788560:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536103.788571:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788536103.788600:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788607:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788536103.788623:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788630:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff90059620f600/0xe79af2f39bbdd789 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd790 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788638:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788536103.788641:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788647:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838600 already unused, calling callback (ffffffffc120ac20) 10000000:00010000:0.0:1788536103.788649:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788656:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788536103.788662:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536103.788666:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788536103.788679:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788684:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788536103.788696:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788703:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff900488838600/0xe79af2f39bbdd77b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe79af2f39bbdd782 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.788716:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536103.788718:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536103.788720:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536103.788729:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536103.788733:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536103.788745:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569473152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788536103.788787:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536103.788812:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788536103.788819:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569473280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788536103.788839:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536103.789042:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488964e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472384:0@lo:104: 00000100:00100000:1.0:1788536103.789055:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488967100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472512:0@lo:104: 00000100:00100000:1.0:1788536103.789063:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488967800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472640:0@lo:104: 00000100:00100000:1.0:1788536103.789071:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488965880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472768:0@lo:104: 00000100:00100000:3.0:1788536103.789288:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569472896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788536103.789315:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536103.789346:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788536103.789351:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569473024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788536103.789370:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536103.789433:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569473152 00000100:00100000:1.0:1788536103.789439:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569473152 00010000:00010000:1.0:1788536103.789464:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd789 expref: 24 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.789481:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569473280 00000100:00100000:1.0:1788536103.789483:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569473280 00010000:00010000:1.0:1788536103.789493:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd77b expref: 25 pid: 17197 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.789502:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569472896 00000100:00100000:1.0:1788536103.789504:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569472896 00010000:00010000:1.0:1788536103.789512:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd911 expref: 26 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.789522:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569473024 00000100:00100000:1.0:1788536103.789524:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569473024 00010000:00010000:1.0:1788536103.789533:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd7c8 expref: 27 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.789545:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788536103.789552:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+27:3662:x1875415569473152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536103.789562:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536103.789574:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd789 expref: 27 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789594:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd789 expref: 27 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789608:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488067e00/0xe79af2f39bbdd790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd789 expref: 27 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789620:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788536103.789662:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+26:3662:x1875415569473152:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536103.789668:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788536103.789683:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788536103.789689:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+25:3662:x1875415569473280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536103.789697:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536103.789701:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd77b expref: 25 pid: 17197 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789709:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd77b expref: 25 pid: 17197 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789718:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632fe00/0xe79af2f39bbdd782 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd77b expref: 25 pid: 17197 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789727:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788536103.789748:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+24:3662:x1875415569473280:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536103.789754:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788536103.789766:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788536103.789778:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+23:3660:x1875415569472896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536103.789786:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536103.789791:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd911 expref: 23 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789799:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd911 expref: 23 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789809:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90058af50000/0xe79af2f39bbdd934 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd911 expref: 23 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789818:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788536103.789843:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+22:3660:x1875415569472896:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536103.789849:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788536103.789862:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788536103.789869:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+21:3660:x1875415569473024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536103.789875:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536103.789879:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe79af2f39bbdd7c8 expref: 21 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789886:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe79af2f39bbdd7c8 expref: 21 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789895:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900580030200/0xe79af2f39bbdd7cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe79af2f39bbdd7c8 expref: 21 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536103.789903:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536103.795529:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569472896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788536103.795598:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569473280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788536103.795609:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25821a76-2177-4c11-bd6b-eb660028a815:3662:1875415569473152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788536103.796378:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536103.796408:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536103.796434:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788536103.796444:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788536103.796551:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548421376 00000100:00100000:2.0:1788536103.796558:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548421376 00010000:00010000:2.0:1788536103.796602:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655768 expref: 13 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536103.796627:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788536103.796631:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548421248 00000100:00100000:2.0:1788536103.796634:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548421248 00000100:00100000:0.0:1788536103.796808:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472128:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788536103.796819:0:20230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20230:1875415569472256:192.168.203.13@tcp:104: 00010000:00010000:0.0:1788536103.796851:0:20230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797041:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d8 expref: 14 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536103.797059:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788536103.797070:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788536103.797079:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900584bae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a65ffba-b89a-415a-8707-2815433dfdf9+14:2401:x1875415548421376:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788536103.797096:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536103.797102:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655768 expref: 14 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797112:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655768 expref: 14 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797129:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff900488839400/0xe79af2f39bbdda7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655768 expref: 14 pid: 17196 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797143:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536103.797223:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900584bae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a65ffba-b89a-415a-8707-2815433dfdf9+13:2401:x1875415548421376:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 145us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536103.797230:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1788536103.797246:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788536103.797252:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1788536103.797267:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a65ffba-b89a-415a-8707-2815433dfdf9+12:2401:x1875415548421248:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788536103.797274:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536103.797279:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d8 expref: 12 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797289:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d8 expref: 12 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797299:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632f800/0xe79af2f39bbddabc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16557d8 expref: 12 pid: 17198 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797312:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797321:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797334:0:17191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797341:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797348:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797355:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797361:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788536103.797366:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797380:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797392:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536103.797401:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788536103.797421:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a65ffba-b89a-415a-8707-2815433dfdf9+11:2401:x1875415548421248:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 155us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536103.797427:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:0.0:1788536103.797702:0:20230:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.797710:0:20230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536103.797716:0:20230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90059632f200/0xe79af2f39bbddaed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536103.801811:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25821a76-2177-4c11-bd6b-eb660028a815+20:3660:x1875415569473024:12345-0@lo:103:ldlm_bl.0 Request processed in 11934us (12431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536103.802004:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788536103.802332:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569473024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788536104.045705:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536104.876494:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788536104.876516:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569473408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788536104.876590:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536104.876885:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569473408 00000100:00100000:2.0:1788536104.876894:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569473408 00000100:00100000:2.0:1788536104.876973:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788536104.876983:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569473408:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788536104.877006:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788536104.877012:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788536104.877083:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569473408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536104.877091:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788536104.877375:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569473408:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1788536104.944388:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788536104.944396:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900488af2800 from 13 10000000:01000000:0.0:1788536104.944402:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788536104.944446:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488839400/0xe79af2f39bbddaf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.944458:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488839400/0xe79af2f39bbddaf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.944475:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488839400/0xe79af2f39bbddaf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536104.944501:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569473536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788536104.944585:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536104.944634:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d46e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788536104.945384:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569473536 00000100:00100000:2.0:1788536104.945393:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569473536 00000100:00100000:2.0:1788536104.945444:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788536104.945453:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+20:17202:x1875415569473536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788536104.945468:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536104.945486:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90058db3ea00/0xe79af2f39bbddafb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbddaf4 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536104.945511:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90058db3ea00/0xe79af2f39bbddafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbddaf4 expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536104.945530:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90058db3ea00/0xe79af2f39bbddafb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbddaf4 expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536104.945550:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3ea00, rc 0) 00000100:00100000:2.0:1788536104.945612:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:17202:x1875415569473536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536104.945619:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788536104.945934:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569473536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536104.945951:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488839400/0xe79af2f39bbddaf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddafb expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.945960:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488839400/0xe79af2f39bbddaf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbddafb expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536104.946029:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569473664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788536104.946060:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536104.946104:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d46e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788536104.946751:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569473664 00000100:00100000:2.0:1788536104.946757:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569473664 00000100:00100000:2.0:1788536104.946798:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788536104.946806:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+21:17202:x1875415569473664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788536104.946923:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+21:17202:x1875415569473664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536104.946930:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788536104.947010:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569473664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788536104.947043:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569473792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788536104.947082:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536104.947111:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d46e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788536104.948202:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569473792 00000100:00100000:2.0:1788536104.948212:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569473792 00000100:00100000:2.0:1788536104.948254:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788536104.948339:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:17202:x1875415569473792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788536104.948532:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+21:17202:x1875415569473792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536104.948540:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788536104.948669:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569473792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788536104.962063:0:20269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788536104.962177:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788536104.962199:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788536104.962211:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488839400/0xe79af2f39bbddaf4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddafb expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536104.962223:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488839400/0xe79af2f39bbddaf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddafb expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788536104.962235:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788536104.962238:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9004878ed800 from 13 10000000:01000000:3.0:1788536104.962253:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788536104.962290:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbddb02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536104.962299:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbddb02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536104.962311:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbddb02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536104.962340:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569473920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788536104.962889:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536104.962944:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9004876ef900 going to sleep for 11 seconds 00000100:00100000:1.0:1788536104.964125:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569473920 00000100:00100000:1.0:1788536104.964138:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569473920 00000100:00100000:1.0:1788536104.964213:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788536104.964223:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+21:17202:x1875415569473920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536104.964239:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536104.964254:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632f400/0xe79af2f39bbddb09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbddb02 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.964357:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632f400/0xe79af2f39bbddb09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbddb02 expref: 22 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.964440:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632f400/0xe79af2f39bbddb09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbddb02 expref: 22 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.964450:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632f400, rc 0) 00000100:00100000:1.0:1788536104.964612:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+22:17202:x1875415569473920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 389us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536104.964620:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788536104.964852:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569473920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536104.964870:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbddb02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddb09 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.964880:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbddb02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbddb09 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536104.964984:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.965015:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536104.965302:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788536104.970980:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569474048 00000100:00100000:0.0:1788536104.970999:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569474048 00000100:00100000:0.0:1788536104.971074:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788536104.971084:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90058319bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+22:17202:x1875415569474048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788536104.971293:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90058319bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+22:17202:x1875415569474048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (6276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536104.971300:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788536104.971516:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.971564:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.971629:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536104.971836:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d4cbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788536104.971899:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569474176 00000100:00100000:2.0:1788536104.971904:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569474176 00000100:00100000:2.0:1788536104.971943:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788536104.971951:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+22:17202:x1875415569474176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788536104.972041:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+22:17202:x1875415569474176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536104.972049:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788536104.972299:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788536104.973238:0:20272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788536104.973479:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788536104.973503:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788536104.973513:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbddb02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddb09 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.973525:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90058af51e00/0xe79af2f39bbddb02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddb09 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788536104.973536:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788536104.973538:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900590d0d800 from 13 10000000:01000000:0.0:1788536104.973542:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788536104.973580:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488839800/0xe79af2f39bbddb10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.973589:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff900488839800/0xe79af2f39bbddb10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.973607:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff900488839800/0xe79af2f39bbddb10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536104.973629:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788536104.973692:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536104.973733:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d46e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788536104.973919:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569474304 00000100:00100000:1.0:1788536104.973925:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569474304 00000100:00100000:1.0:1788536104.973965:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788536104.973974:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900583199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+22:17202:x1875415569474304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536104.973985:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536104.973996:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632e200/0xe79af2f39bbddb17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbddb10 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.974018:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632e200/0xe79af2f39bbddb17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbddb10 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.974029:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632e200/0xe79af2f39bbddb17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbddb10 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.974038:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632e200, rc 0) 00000100:00100000:1.0:1788536104.974073:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900583199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569474304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536104.974086:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788536104.975391:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536104.975413:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff900488839800/0xe79af2f39bbddb10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddb17 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.975424:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff900488839800/0xe79af2f39bbddb10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbddb17 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536104.975496:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788536104.975540:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536104.975564:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d46e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788536104.976378:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569474432 00000100:00100000:1.0:1788536104.976387:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569474432 00000100:00100000:1.0:1788536104.976428:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788536104.976437:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569474432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.976564:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569474432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536104.976582:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788536104.976816:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788536104.976852:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788536104.976891:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536104.976923:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059d46e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788536104.976962:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569474560 00000100:00100000:1.0:1788536104.976966:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569474560 00000100:00100000:1.0:1788536104.976997:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788536104.977004:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569474560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.977078:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569474560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536104.977084:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788536104.977369:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788536104.978623:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788536104.978920:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788536104.978941:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536104.978950:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff900488839800/0xe79af2f39bbddb10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddb17 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.978962:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff900488839800/0xe79af2f39bbddb10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddb17 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788536104.978972:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788536104.978974:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff900586554800 from 13 10000000:01000000:1.0:1788536104.978978:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788536104.979008:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbddb1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.979023:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbddb1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.979033:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbddb1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536104.979054:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.979106:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536104.979143:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900585266c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788536104.979655:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569474688 00000100:00100000:0.0:1788536104.979662:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569474688 00000100:00100000:0.0:1788536104.980379:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788536104.980391:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+23:17202:x1875415569474688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536104.980407:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536104.980423:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488838c00/0xe79af2f39bbddb25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe79af2f39bbddb1e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.980447:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488838c00/0xe79af2f39bbddb25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe79af2f39bbddb1e expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.980458:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488838c00/0xe79af2f39bbddb25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe79af2f39bbddb1e expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536104.980767:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488838c00, rc 0) 00000100:00100000:0.0:1788536104.980960:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:17202:x1875415569474688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 571us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536104.980968:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788536104.981039:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536104.981059:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbddb1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddb25 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.981070:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbddb1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe79af2f39bbddb25 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536104.981135:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.981585:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536104.981616:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900585266c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788536104.981763:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569474816 00000100:00100000:2.0:1788536104.981769:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569474816 00000100:00100000:2.0:1788536104.981799:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788536104.981806:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:17202:x1875415569474816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788536104.981907:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25821a76-2177-4c11-bd6b-eb660028a815+24:17202:x1875415569474816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536104.981914:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788536104.982822:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.982867:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.982931:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536104.982959:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff900585266c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536104.984406:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569474944 00000100:00100000:1.0:1788536104.984417:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569474944 00000100:00100000:1.0:1788536104.984485:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788536104.984494:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:17202:x1875415569474944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536104.984639:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:17202:x1875415569474944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536104.984646:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788536104.984833:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25821a76-2177-4c11-bd6b-eb660028a815:17202:1875415569474944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788536104.987008:0:20274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788536104.987092:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788536104.987114:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788536104.987127:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbddb1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddb25 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536104.987140:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff90059632fe00/0xe79af2f39bbddb1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe79af2f39bbddb25 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536105.068803:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536105.388924:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569475072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788536105.388992:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536105.389557:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569475072 00000100:00100000:1.0:1788536105.389565:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569475072 00000100:00100000:1.0:1788536105.389645:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788536105.389657:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569475072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788536105.389685:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788536105.389708:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569475200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788536105.389735:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569475072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536105.389736:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536105.389741:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788536105.389755:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569475200 00000100:00100000:1.0:1788536105.389758:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569475200 00000100:00100000:1.0:1788536105.389774:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788536105.389780:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569475200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788536105.389806:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788536105.389843:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875415569475200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536105.389849:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788536105.389885:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788536105.389937:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569475328:0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.389972:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536105.390003:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569475840:0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390026:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536105.390046:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569476352:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390067:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569475840 00000100:00100000:0.0:1788536105.390069:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536105.390070:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569475840 00000100:00100000:0.0:1788536105.390088:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788536105.390094:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569475712:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390098:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788536105.390104:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569475840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390122:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536105.390138:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569475840:12345-0@lo:400:kworker.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536105.390161:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788536105.390165:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569476224:0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390188:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536105.390207:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569476352 00000100:00100000:2.0:1788536105.390211:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569476352 00000100:00100000:0.0:1788536105.390225:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569475840:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390240:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569475712 00000100:00100000:2.0:1788536105.390242:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569475712 00000100:00100000:2.0:1788536105.390253:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569476224 00000100:00100000:0.0:1788536105.390253:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569475328 00000100:00100000:2.0:1788536105.390256:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569476224 00000100:00100000:0.0:1788536105.390256:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569475328 00000100:00100000:2.0:1788536105.390268:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788536105.390274:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569476352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390280:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788536105.390285:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+24:3663:x1875415569475328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390308:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875415569476352:12345-0@lo:400:kworker.0 Request processed in 34us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536105.390309:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25821a76-2177-4c11-bd6b-eb660028a815+24:3663:x1875415569475328:12345-0@lo:400:kworker.0 Request processed in 24us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536105.390314:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788536105.390319:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788536105.390329:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788536105.390334:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569475712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390341:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788536105.390347:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569476224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390361:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569475712:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536105.390368:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788536105.390368:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875415569476224:12345-0@lo:400:kworker.0 Request processed in 22us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536105.390373:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788536105.390383:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788536105.390386:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788536105.390395:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569475584:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390401:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569475712:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390411:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3663:1875415569476224:0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390420:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788536105.390422:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879c8e00 x1875415569476352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536105.390431:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3663:1875415569476352:0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390436:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569476096:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390439:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25821a76-2177-4c11-bd6b-eb660028a815:3663:1875415569475328:0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390454:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536105.390464:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569476096 00000100:00100000:0.0:1788536105.390466:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569476608:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390467:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569476096 00000100:00100000:2.0:1788536105.390487:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788536105.390490:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536105.390493:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569476096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390516:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488965180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569475072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788536105.390518:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875415569476096:12345-0@lo:400:kworker.0 Request processed in 26us (64us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536105.390524:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788536105.390532:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569476608 00000100:00100000:2.0:1788536105.390534:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569476608 00000100:00100000:0.0:1788536105.390534:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875415569476096:0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390547:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788536105.390554:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569475456:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390556:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788536105.390583:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569476608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390592:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536105.390610:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875415569476608:12345-0@lo:400:kworker.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536105.390611:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569475968:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390616:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788536105.390630:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788536105.390632:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788536105.390642:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569475584 00000100:00100000:0.0:1788536105.390645:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569476480:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390646:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569475584 00000100:00100000:0.0:1788536105.390666:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536105.390667:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569475968 00000100:00100000:2.0:1788536105.390670:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569475968 00010000:00080000:0.0:1788536105.390686:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9004879c8700 x1875415569476608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788536105.390695:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3661:1875415569476608:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390703:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788536105.390710:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569475584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.390714:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536105.390721:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569475968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390744:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569475584:12345-0@lo:400:kworker.0 Request processed in 35us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536105.390744:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569475968:12345-0@lo:400:kworker.0 Request processed in 23us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536105.390751:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788536105.390769:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788536105.390776:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569476480 00000100:00100000:2.0:1788536105.390779:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569476480 00000100:00100000:2.0:1788536105.390802:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788536105.390808:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569476480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390853:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875415569476480:12345-0@lo:400:kworker.0 Request processed in 45us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536105.390859:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788536105.390874:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788536105.390890:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569475968:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390899:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3661:1875415569476480:0@lo:400:kworker.0 00000100:00100000:2.0:1788536105.390907:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569475584:0@lo:400:kworker.0 00000100:00100000:3.0:1788536105.392422:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3662:1875415569475200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788536105.397745:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788536105.397805:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569475456 00000100:00100000:0.0:1788536105.397815:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569475456 00000100:00100000:0.0:1788536105.397876:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788536105.397886:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569475456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788536105.397997:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875415569475456:12345-0@lo:400:kworker.0 Request processed in 112us (7402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536105.398003:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788536105.399643:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3661:1875415569475456:0@lo:400:kworker.0 00000100:00100000:3.0:1788536105.468488:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536105.468552:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548421504 00000100:00100000:1.0:1788536105.468561:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548421504 00000100:00100000:1.0:1788536105.468623:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:1.0:1788536105.468633:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+11:14944:x1875415548421504:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788536105.468650:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536105.468668:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90059632f800/0xe79af2f39bbddb2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655810 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536105.468696:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90059632f800/0xe79af2f39bbddb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655810 expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536105.468708:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90059632f800/0xe79af2f39bbddb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655810 expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536105.468717:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059632f800, rc 0) 00000100:00100000:1.0:1788536105.468777:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+12:14944:x1875415548421504:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 145us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536105.468784:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:0.0:1788536105.472404:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536105.472605:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548421632 00000100:00100000:3.0:1788536105.472615:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548421632 00000100:00100000:3.0:1788536105.472671:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:3.0:1788536105.472682:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+12:14944:x1875415548421632:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788536105.472834:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+12:14944:x1875415548421632:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 154us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536105.472841:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:3.0:1788536105.475713:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536105.475790:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548421760 00000100:00100000:0.0:1788536105.475800:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548421760 00000100:00100000:0.0:1788536105.475869:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:0.0:1788536105.475878:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+12:14944:x1875415548421760:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788536105.476023:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+12:14944:x1875415548421760:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 145us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536105.476031:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:3.0:1788536105.504127:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536105.504369:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548421888 00000100:00100000:0.0:1788536105.504379:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548421888 00000100:00100000:0.0:1788536105.504434:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:0.0:1788536105.504444:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+12:14944:x1875415548421888:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788536105.504459:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536105.504475:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff900488839600/0xe79af2f39bbddb33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655817 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536105.504501:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff900488839600/0xe79af2f39bbddb33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655817 expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536105.504512:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff900488839600/0xe79af2f39bbddb33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655817 expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536105.504520:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488839600, rc 0) 00000100:00100000:0.0:1788536105.504581:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+13:14944:x1875415548421888:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 138us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536105.504588:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:1.0:1788536105.518221:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536105.518378:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548422016 00000100:00100000:3.0:1788536105.518401:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548422016 00000100:00100000:3.0:1788536105.518460:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:3.0:1788536105.518470:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+13:14944:x1875415548422016:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788536105.518643:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a65ffba-b89a-415a-8707-2815433dfdf9+13:14944:x1875415548422016:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 163us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536105.518652:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:3.0:1788536105.524821:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536105.525180:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548422144 00000100:00100000:1.0:1788536105.525189:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548422144 00000100:00100000:1.0:1788536105.525239:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:1.0:1788536105.525262:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+13:14944:x1875415548422144:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788536105.525382:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a65ffba-b89a-415a-8707-2815433dfdf9+13:14944:x1875415548422144:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 122us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536105.525389:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00010000:00010000:0.0:1788536106.092528:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536107.118700:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788536107.214373:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536107.214469:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548422272 00000100:00100000:0.0:1788536107.214479:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548422272 00000100:00100000:0.0:1788536107.214591:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1788536107.214602:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:15615:x1875415548422272:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788536107.214640:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536107.214661:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbddb3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165581e expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.214725:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.214738:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.214752:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.214765:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.214772:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.214779:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.214867:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbddb4f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.214875:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbddb4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.214881:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbddb4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788536107.214932:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788536107.214942:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788536107.214990:0:17205:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbddb4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215003:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215010:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215018:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215023:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488839c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788536107.215028:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215035:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215046:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936a00) 00010000:00010000:0.0:1788536107.215049:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536107.215054:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215061:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839c00/0xe79af2f39bbddb41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215074:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215079:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215095:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215101:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488838600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788536107.215104:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215110:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215118:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9005b7af4300) 00010000:00010000:0.0:1788536107.215120:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536107.215123:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215129:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488838600/0xe79af2f39bbddb48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215245:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488839200/0xe79af2f39bbddb3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165581e expref: 8 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215262:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f600/0xe79af2f39bbddb4f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165581e expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.215269:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9005b7af4f00) 00010000:00010000:0.0:1788536107.215271:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788536107.215274:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f600, rc 0) 00000100:00100000:0.0:1788536107.215336:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:15615:x1875415548422272:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 735us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536107.215353:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00080000:2.0:1788536107.216756:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788536107.228553:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.229202:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548422400 00000100:00100000:2.0:1788536107.229212:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548422400 00000100:00100000:2.0:1788536107.229272:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1788536107.229282:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:15615:x1875415548422400:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788536107.229373:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:15615:x1875415548422400:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 93us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536107.229382:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1788536107.233772:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.233956:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548422656 00000100:00100000:2.0:1788536107.233966:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548422656 00000100:00100000:2.0:1788536107.234028:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1788536107.234039:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:15615:x1875415548422656:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788536107.234062:0:19995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536107.234091:0:19995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddb56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655825 expref: -99 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234206:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234219:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234230:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234295:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234321:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234329:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234441:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f400/0xe79af2f39bbddb6b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234450:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f400/0xe79af2f39bbddb6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234457:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f400/0xe79af2f39bbddb6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536107.234466:0:19995:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788536107.234633:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234641:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234647:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234653:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3f000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536107.234657:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234665:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234928:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9005b7af4f00) 00010000:00010000:2.0:1788536107.234931:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536107.234935:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234942:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb5d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234957:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234964:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234970:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234976:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536107.234979:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234985:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.234993:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff900583bb4900) 00010000:00010000:2.0:1788536107.234996:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536107.234999:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.235004:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb64 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.236786:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddb56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655825 expref: 10 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.236814:0:19995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f400/0xe79af2f39bbddb6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655825 expref: 9 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.236824:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900583bb4700) 00010000:00010000:2.0:1788536107.236826:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536107.236841:0:19995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3f400, rc 0) 00000100:00100000:2.0:1788536107.236921:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:15615:x1875415548422656:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2882us (3157us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788536107.236931:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1788536107.241335:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536107.241493:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548422784 00000100:00100000:0.0:1788536107.241503:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548422784 00000100:00100000:0.0:1788536107.241572:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1788536107.241582:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:15615:x1875415548422784:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788536107.241702:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:15615:x1875415548422784:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 121us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536107.241711:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1788536107.247089:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536107.247192:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548422912 00000100:00100000:0.0:1788536107.247204:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548422912 00000100:00100000:0.0:1788536107.247281:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1788536107.247292:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:15615:x1875415548422912:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788536107.247493:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788536107.248324:0:17206:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 991us 00000100:00100000:1.0:1788536107.261642:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:15615:x1875415548422912:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 14344us (14566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536107.261656:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:3.0:1788536107.273036:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536107.273346:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548423040 00000100:00100000:0.0:1788536107.273356:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548423040 00000100:00100000:0.0:1788536107.273417:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788536107.273428:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:15621:x1875415548423040:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1788536107.273448:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536107.273470:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddb79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165582c expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273526:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273539:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273550:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273590:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273598:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273605:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273648:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273653:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273658:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273661:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788536107.273664:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273674:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273683:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936a00) 00010000:00010000:0.0:1788536107.273685:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536107.273688:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273692:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddb80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273708:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273712:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273715:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273718:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788536107.273719:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273723:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273727:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9005b7af4300) 00010000:00010000:0.0:1788536107.273728:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536107.273729:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273732:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddb87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273754:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddb79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165582c expref: 10 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273760:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936a00) 00010000:00010000:0.0:1788536107.273762:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536107.273768:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddb79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165582c expref: 10 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.273775:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620f200, rc 0) 00000100:00100000:0.0:1788536107.273830:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:15621:x1875415548423040:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 404us (804us total) trans 0 rc 301/301 00000100:00100000:0.0:1788536107.273837:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788536107.282744:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536107.283035:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548423168 00000100:00100000:1.0:1788536107.283046:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548423168 00000100:00100000:1.0:1788536107.283105:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788536107.283115:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:15621:x1875415548423168:12345-192.168.203.13@tcp:700:lfs.0 00000100:00100000:1.0:1788536107.283212:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:15621:x1875415548423168:12345-192.168.203.13@tcp:700:lfs.0 Request processed in 98us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536107.283219:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1788536107.286998:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.287060:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548423424 00000100:00100000:3.0:1788536107.287127:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548423424 00000100:00100000:2.0:1788536107.287448:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1788536107.287468:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:15621:x1875415548423424:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:2.0:1788536107.287527:0:19995:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788536107.287565:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbddaa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655799 expref: 9 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.287586:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936a00) 00010000:00010000:2.0:1788536107.287591:0:19995:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788536107.287657:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.287671:0:19995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655809 expref: 5 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.287695:0:19995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.287730:0:19995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655809 expref: 5 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.287745:0:19995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655809 expref: 5 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536107.287758:0:19995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19995:1875415569476736:192.168.203.13@tcp:104: 00000100:00100000:2.0:1788536107.289480:0:19995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b98c90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788536107.297801:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.297833:0:19995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19995:1875415569476736:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788536107.297871:0:19995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536107.298141:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548423552 00000100:00100000:0.0:1788536107.298420:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548423552 00010000:00010000:0.0:1788536107.298506:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655809 expref: 6 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536107.298565:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1788536107.298575:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+6:2401:x1875415548423552:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788536107.298590:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536107.298596:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655809 expref: 6 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.298620:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655809 expref: 6 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.298643:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655809 expref: 6 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.298660:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936a00) 00010000:00010000:0.0:1788536107.298665:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.298692:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.298699:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.298731:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536107.298783:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2401:x1875415548423552:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 208us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536107.298791:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:1.0:1788536107.299100:0:19995:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.299109:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.299138:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.299353:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.299363:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788536107.303225:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788536107.307475:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307497:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307510:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788536107.307524:0:19995:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000daf54b3c reply state 00000000bd7c49c5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307546:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307565:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:2.0:1788536107.307568:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788536107.307572:0:19995:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788536107.307578:0:19995:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788536107.307587:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307595:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307610:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307616:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536107.307621:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307630:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307640:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff900486936a00) 00010000:00010000:2.0:1788536107.307642:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536107.307645:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307651:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddb8e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788536107.307681:0:19995:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000daf54b3c reply state 00000000bd7c49c5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307690:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.307696:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90059d464c00) 00010000:00010000:2.0:1788536107.307698:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788536107.307700:0:19995:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788536107.307810:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+10:15621:x1875415548423424:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 20348us (20821us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788536107.307819:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000040:00080000:2.0:1788536107.373131:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788536107.387262:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.387312:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.387345:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.387366:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.387397:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.387441:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.387470:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548423808 00000100:00100000:3.0:1788536107.387481:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548423808 00000100:00100000:3.0:1788536107.387541:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548423936 00000100:00100000:3.0:1788536107.387544:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548423936 00000100:00100000:3.0:1788536107.387570:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548424192 00000100:00100000:3.0:1788536107.387574:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548424192 00000100:00100000:3.0:1788536107.387587:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548424320 00000100:00100000:3.0:1788536107.387589:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548424320 00000100:00100000:3.0:1788536107.387614:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788536107.387624:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2400:x1875415548423808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788536107.387712:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2400:x1875415548423808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 89us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.387720:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788536107.387739:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788536107.387746:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2399:x1875415548423936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788536107.387770:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2399:x1875415548423936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.387776:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1788536107.387788:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788536107.387793:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2399:x1875415548424192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788536107.387816:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2399:x1875415548424192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.387822:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1788536107.387833:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788536107.387838:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2400:x1875415548424320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788536107.387860:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2400:x1875415548424320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 21us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.387865:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1788536107.387882:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548424064 00000100:00100000:3.0:1788536107.387885:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548424064 00000100:00080000:0.0:1788536107.389289:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788536107.389296:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788536107.389504:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548423680 00000100:00100000:1.0:1788536107.389513:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548423680 00000100:00100000:3.0:1788536107.390095:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1788536107.390105:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2400:x1875415548424064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1788536107.390187:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+5:2400:x1875415548424064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 83us (2788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.390207:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1788536107.390319:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:1.0:1788536107.390329:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+13:2399:x1875415548423680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1788536107.390358:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a65ffba-b89a-415a-8707-2815433dfdf9+13:2399:x1875415548423680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536107.390364:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00080000:2.0:1788536107.390426:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788536107.403368:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536107.403564:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548424448 00000100:00100000:1.0:1788536107.403578:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548424448 00000100:00100000:1.0:1788536107.403719:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1788536107.403731:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+10:15629:x1875415548424448:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:1.0:1788536107.403756:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536107.403780:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbddba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655833 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.403843:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbddbaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.403862:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbddbaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.403891:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbddbaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788536107.403941:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788536107.403945:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788536107.403982:0:17206:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbddbaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.404005:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbddba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655833 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.404025:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067000/0xe79af2f39bbddbaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655833 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.404034:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464100) 00010000:00010000:1.0:1788536107.404037:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788536107.404040:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488067000, rc 0) 00000100:00100000:1.0:1788536107.404101:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+11:15629:x1875415548424448:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 372us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536107.404108:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1788536107.427946:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.428095:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548424576 00000100:00100000:3.0:1788536107.428105:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548424576 00000100:00100000:3.0:1788536107.428187:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1788536107.428197:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+5:15631:x1875415548424576:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788536107.428215:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536107.428234:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddbb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165583a expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.428304:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbddbb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.428317:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbddbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.428330:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbddbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536107.428377:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788536107.428381:0:17204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788536107.428404:0:17204:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbddbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.428427:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddbb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165583a expref: 7 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.428445:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50400/0xe79af2f39bbddbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165583a expref: 6 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.428472:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464100) 00010000:00010000:3.0:1788536107.428476:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788536107.428479:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50400, rc 0) 00000100:00100000:3.0:1788536107.428540:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15631:x1875415548424576:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 344us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.428547:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1788536107.437035:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788536107.437058:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569476864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788536107.437133:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536107.437203:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.437211:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569476864 00000100:00100000:3.0:1788536107.437219:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569476864 00000100:00100000:0.0:1788536107.437237:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548424704 00000100:00100000:3.0:1788536107.437274:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788536107.437283:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569476864:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788536107.437318:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548424704 00000004:00000024:3.0:1788536107.437321:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788536107.437370:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1788536107.437375:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569476864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536107.437384:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38196aad-db5b-40a4-908a-ec1a96ba5904+6:15631:x1875415548424704:12345-192.168.203.13@tcp:101:lfs.0 00000100:00100000:3.0:1788536107.437389:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:0.0:1788536107.437400:0:19995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536107.437423:0:19995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddbbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655841 expref: -99 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536107.437440:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569476864:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788536107.437481:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437497:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437509:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437539:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437548:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437569:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437647:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddbd4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437655:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437662:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788536107.437699:0:19995:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788536107.437703:0:19995:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788536107.437720:0:19995:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437733:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437740:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437746:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437775:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620f200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788536107.437780:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437787:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437801:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464100) 00010000:00010000:0.0:1788536107.437804:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536107.437809:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.437815:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddbc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438330:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438340:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438346:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438351:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059620e800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788536107.438355:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438360:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438381:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90059d464c00) 00010000:00010000:0.0:1788536107.438383:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536107.438387:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438393:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e800/0xe79af2f39bbddbcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438425:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e200/0xe79af2f39bbddbbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655841 expref: 8 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438439:0:19995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655841 expref: 7 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.438446:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:0.0:1788536107.438449:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788536107.438451:0:19995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e000, rc 0) 00000100:00100000:0.0:1788536107.438585:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38196aad-db5b-40a4-908a-ec1a96ba5904+7:15631:x1875415548424704:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1205us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536107.438592:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1788536107.444266:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.444413:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548424832 00000100:00100000:2.0:1788536107.444424:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548424832 00000100:00100000:2.0:1788536107.444484:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788536107.444496:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:38196aad-db5b-40a4-908a-ec1a96ba5904+5:15631:x1875415548424832:12345-192.168.203.13@tcp:900:lfs.0 00000100:00100000:2.0:1788536107.444599:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:38196aad-db5b-40a4-908a-ec1a96ba5904+5:15631:x1875415548424832:12345-192.168.203.13@tcp:900:lfs.0 Request processed in 104us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536107.444607:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788536107.447407:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.447488:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548425088 00000100:00100000:3.0:1788536107.447499:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548425088 00000100:00100000:3.0:1788536107.447573:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:3.0:1788536107.447586:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+7:15631:x1875415548425088:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1788536107.447615:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536107.447637:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddbdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655848 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536107.447952:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788536107.448058:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddbdb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655848 expref: 9 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.448072:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464100) 00010000:00010000:3.0:1788536107.448074:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788536107.448079:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddbdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655848 expref: 9 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.448092:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51000, rc 0) 00000100:00100000:3.0:1788536107.450321:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+8:15631:x1875415548425088:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2726us (3076us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788536107.450332:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:3.0:1788536107.459840:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536107.460177:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548425344 00000100:00100000:1.0:1788536107.460187:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548425344 00000100:00100000:1.0:1788536107.460251:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1788536107.460262:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+8:15631:x1875415548425344:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:1.0:1788536107.460313:0:17206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536107.460338:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e000/0xe79af2f39bbddbd4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655841 expref: 8 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.460357:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:1.0:1788536107.460375:0:17206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788536107.460397:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.460410:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.460420:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788536107.460613:0:17206:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000ff2b0105 reply state 00000000c808048b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.460627:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.460634:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:1.0:1788536107.460636:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788536107.460639:0:17206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788536107.460647:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788536107.460729:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+9:15631:x1875415548425344:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 469us (898us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788536107.460736:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1788536107.463131:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.463275:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548425600 00000100:00100000:2.0:1788536107.463285:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548425600 00000100:00100000:2.0:1788536107.463335:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1788536107.463345:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+9:15631:x1875415548425600:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788536107.463551:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+10:15631:x1875415548425600:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 207us (429us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788536107.463582:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788536107.465903:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.466048:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548425856 00000100:00100000:2.0:1788536107.466057:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548425856 00000100:00100000:2.0:1788536107.466117:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1788536107.466127:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+10:15631:x1875415548425856:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788536107.466173:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536107.466194:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddbf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165584f expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466262:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466277:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466289:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466301:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466323:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466330:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536107.466422:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788536107.466489:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466512:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466520:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466526:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3fe00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536107.466530:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466538:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466549:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464100) 00010000:00010000:2.0:1788536107.466552:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536107.466573:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466580:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddbf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466594:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466600:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466606:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466611:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536107.466631:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466638:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466647:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90059d464c00) 00010000:00010000:2.0:1788536107.466649:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536107.466653:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466660:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddbfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466967:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddbf0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165584f expref: 12 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466979:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464100) 00010000:00010000:2.0:1788536107.466981:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788536107.466985:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddbf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165584f expref: 12 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.466995:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3ec00, rc 0) 00000100:00100000:2.0:1788536107.467098:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+11:15631:x1875415548425856:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 972us (1202us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788536107.467106:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1788536107.470459:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536107.470547:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548425984 00000100:00100000:1.0:1788536107.470568:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548425984 00000100:00100000:1.0:1788536107.470635:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1788536107.470644:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+11:15631:x1875415548425984:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1788536107.470667:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536107.470699:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066e00/0xe79af2f39bbddc0c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655856 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.470808:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.470821:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.470832:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788536107.470856:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788536107.470861:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788536107.470893:0:17206:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.470917:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066e00/0xe79af2f39bbddc0c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655856 expref: 13 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.470936:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655856 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.470944:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:1.0:1788536107.470946:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788536107.470950:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066000, rc 0) 00000100:00100000:1.0:1788536107.471008:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38196aad-db5b-40a4-908a-ec1a96ba5904+12:15631:x1875415548425984:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 365us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536107.471015:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1788536107.474569:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.475678:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548426112 00000100:00100000:2.0:1788536107.475691:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548426112 00000100:00100000:2.0:1788536107.475752:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1788536107.475764:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+12:15631:x1875415548426112:12345-192.168.203.13@tcp:37:lfs.0 00000100:00100000:2.0:1788536107.481940:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38196aad-db5b-40a4-908a-ec1a96ba5904+12:15631:x1875415548426112:12345-192.168.203.13@tcp:37:lfs.0 Request processed in 6168us (7383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536107.481953:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1788536107.485969:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536107.486047:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548426368 00000100:00100000:1.0:1788536107.486058:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548426368 00000100:00100000:1.0:1788536107.486131:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1788536107.486141:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e5d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+12:15631:x1875415548426368:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1788536107.486382:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e5d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+13:15631:x1875415548426368:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 241us (422us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788536107.486391:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1788536107.525264:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.528352:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548426496 00000100:00100000:3.0:1788536107.528366:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548426496 00000100:00100000:3.0:1788536107.528433:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1788536107.528442:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+11:15637:x1875415548426496:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788536107.528460:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536107.528478:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddc1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165585d expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528536:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528574:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528586:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528597:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528604:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528610:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528689:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbddc2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528697:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbddc2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528703:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbddc2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536107.528735:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788536107.528739:0:17204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788536107.528773:0:17204:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbddc2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528786:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528801:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528809:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528814:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788536107.528818:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528825:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528836:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464100) 00010000:00010000:3.0:1788536107.528839:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536107.528844:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528850:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddc21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528863:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528868:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528874:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528879:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788536107.528887:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528893:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528901:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90059d464c00) 00010000:00010000:3.0:1788536107.528903:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536107.528906:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528912:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528938:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddc1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165585d expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528951:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51c00/0xe79af2f39bbddc2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165585d expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.528957:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:3.0:1788536107.528959:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788536107.528962:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51c00, rc 0) 00000100:00100000:3.0:1788536107.529030:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+12:15637:x1875415548426496:12345-192.168.203.13@tcp:101:bash.0 Request processed in 589us (3779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.529037:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1788536107.541425:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.541487:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548426624 00000100:00100000:2.0:1788536107.541499:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548426624 00000100:00100000:2.0:1788536107.541572:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788536107.541582:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:15637:x1875415548426624:12345-192.168.203.13@tcp:900:bash.0 00000100:00100000:2.0:1788536107.541786:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:15637:x1875415548426624:12345-192.168.203.13@tcp:900:bash.0 Request processed in 204us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536107.541794:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1788536107.543912:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536107.543981:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548426880 00000100:00100000:1.0:1788536107.543989:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548426880 00000100:00100000:1.0:1788536107.544056:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:1.0:1788536107.544065:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+12:15637:x1875415548426880:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1788536107.544085:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536107.544104:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066e00/0xe79af2f39bbddc36 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655864 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.544246:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.544260:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655856 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.544269:0:17206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.544301:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655856 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.544315:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655856 expref: 12 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536107.544346:0:17206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875415569476992:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788536107.544426:0:17206:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788536107.546294:0:17206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488966a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875415569476992:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788536107.546320:0:17206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536107.551508:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.551629:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548427008 00000100:00100000:3.0:1788536107.551640:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548427008 00010000:00010000:3.0:1788536107.551684:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655856 expref: 13 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536107.551744:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1788536107.551754:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+13:2402:x1875415548427008:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536107.551769:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536107.551776:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655856 expref: 13 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.551789:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655856 expref: 13 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.551812:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655856 expref: 13 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.551829:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:3.0:1788536107.551834:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.551843:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.551849:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.551886:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536107.551943:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38196aad-db5b-40a4-908a-ec1a96ba5904+12:2402:x1875415548427008:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 191us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.551951:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00010000:00010000:2.0:1788536107.552189:0:17206:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552198:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552224:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552234:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552243:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552716:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552732:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552754:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536107.552766:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788536107.552796:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552803:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552810:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552816:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066c00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536107.552820:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552828:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552838:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:2.0:1788536107.552841:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536107.552845:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552851:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddc3d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788536107.552870:0:17206:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000e524260d reply state 000000005fcce5d7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552892:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552898:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff900583bb4400) 00010000:00010000:2.0:1788536107.552900:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788536107.552903:0:17206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788536107.552939:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066e00/0xe79af2f39bbddc36 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655864 expref: 15 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552957:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655864 expref: 14 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.552968:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536107.552970:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788536107.552972:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3e600, rc 0) 00000100:00100000:2.0:1788536107.553042:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+15:15637:x1875415548426880:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8979us (9138us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788536107.553049:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1788536107.563832:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536107.563940:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548427136 00000100:00100000:3.0:1788536107.563957:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548427136 00000100:00100000:3.0:1788536107.564123:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1788536107.564134:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+15:15637:x1875415548427136:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1788536107.564202:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536107.564222:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddc59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165586b expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.564292:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.564307:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.564320:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788536107.564375:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788536107.564380:0:17204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788536107.564401:0:17204:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.564413:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.564437:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddc59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165586b expref: 17 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.564453:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165586b expref: 16 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536107.564461:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:3.0:1788536107.564469:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788536107.564474:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50800, rc 0) 00000100:00100000:3.0:1788536107.564519:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+16:15637:x1875415548427136:12345-192.168.203.13@tcp:101:bash.0 Request processed in 388us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.564526:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:0.0:1788536107.572530:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536107.572618:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548427392 00000100:00100000:1.0:1788536107.572628:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548427392 00000100:00100000:1.0:1788536107.572773:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1788536107.572785:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+16:15637:x1875415548427392:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1788536107.573202:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+17:15637:x1875415548427392:12345-192.168.203.13@tcp:35:bash.0 Request processed in 418us (679us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788536107.573211:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000040:00080000:1.0:1788536107.629626:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788536107.676578:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.676709:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548427648 00000100:00100000:2.0:1788536107.676721:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548427648 00000100:00100000:2.0:1788536107.676791:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1788536107.676802:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+17:15647:x1875415548427648:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788536107.676828:0:19995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536107.676856:0:19995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddc67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655872 expref: -99 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536107.676982:0:19995:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788536107.677108:0:19995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddc67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655872 expref: 19 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.677123:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90059d464100) 00010000:00010000:2.0:1788536107.677126:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788536107.677131:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddc67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655872 expref: 19 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.677450:0:19995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3fe00, rc 0) 00000100:00100000:3.0:1788536107.677595:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+18:15647:x1875415548427648:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 793us (1039us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788536107.677604:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1788536107.680939:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.681009:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548427904 00000100:00100000:2.0:1788536107.681020:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548427904 00000100:00100000:2.0:1788536107.681076:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1788536107.681085:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+18:15647:x1875415548427904:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788536107.681321:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+19:15647:x1875415548427904:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 235us (391us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788536107.681329:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1788536107.714570:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536107.714680:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548428160 00000100:00100000:2.0:1788536107.714691:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548428160 00000100:00100000:2.0:1788536107.714755:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1788536107.714766:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+19:15650:x1875415548428160:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1788536107.714789:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536107.714809:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddc75 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655879 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.714928:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.714943:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.714969:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536107.714983:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788536107.715086:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddc75 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655879 expref: 22 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.715106:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655879 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536107.715116:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536107.715119:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788536107.715122:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3fc00, rc 0) 00000100:00100000:2.0:1788536107.715242:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+21:15650:x1875415548428160:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 477us (692us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788536107.715249:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1788536107.719245:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536107.719327:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548428288 00000100:00100000:1.0:1788536107.719337:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548428288 00000100:00100000:1.0:1788536107.719400:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:1.0:1788536107.719410:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+21:15650:x1875415548428288:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1788536107.719485:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.719502:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.719514:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.719581:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.719589:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.719597:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.719603:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488066000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788536107.719607:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.719615:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.719627:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:1.0:1788536107.719630:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788536107.719635:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536107.719642:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066000/0xe79af2f39bbddc8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536107.719729:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+21:15650:x1875415548428288:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 320us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536107.719738:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:1.0:1788536107.723074:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536107.723116:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536107.723269:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548428416 00000100:00100000:0.0:1788536107.723278:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548428416 00000100:00100000:0.0:1788536107.723353:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1788536107.723364:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+21:2402:x1875415548428416:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788536107.723379:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536107.723407:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655879 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536107.723428:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:0.0:1788536107.723432:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536107.723492:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488965880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+20:2402:x1875415548428416:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 131us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536107.723499:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1788536107.723660:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548428672 00000100:00100000:2.0:1788536107.723670:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548428672 00000100:00100000:2.0:1788536107.723707:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1788536107.723714:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+20:15650:x1875415548428672:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1788536107.723906:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+21:15650:x1875415548428672:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 192us (788us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788536107.723912:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1788536107.948433:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569477120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788536107.948526:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536107.948941:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569477120 00000100:00100000:0.0:1788536107.948951:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569477120 00000100:00100000:0.0:1788536107.949009:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788536107.949020:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569477120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788536107.949054:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788536107.949102:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569477120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536107.949109:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788536107.949263:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569477120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788536107.949502:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788536107.949514:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569477248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788536107.949560:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788536107.949805:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569477248 00000100:00100000:3.0:1788536107.949812:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569477248 00000100:00100000:3.0:1788536107.949866:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788536107.949875:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569477248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788536107.949894:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788536107.949952:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569477248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536107.949958:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788536107.950075:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569477248:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788536107.950322:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788536108.043651:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.044099:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548428928 00000100:00100000:2.0:1788536108.044110:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548428928 00000100:00100000:2.0:1788536108.044199:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1788536108.044210:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+21:15681:x1875415548428928:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1788536108.044235:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536108.044258:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddc91 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655880 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.044370:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.044385:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.044397:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536108.044409:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788536108.044532:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddc91 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655880 expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.044564:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655880 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.044574:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536108.044576:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788536108.044580:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3fc00, rc 0) 00000100:00100000:2.0:1788536108.044903:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+23:15681:x1875415548428928:12345-192.168.203.13@tcp:101:cat.0 Request processed in 694us (1260us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788536108.044929:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1788536108.049449:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536108.049530:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.049740:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548429056 00000100:00100000:3.0:1788536108.049752:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548429056 00000100:00100000:3.0:1788536108.049814:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1788536108.049822:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+23:2401:x1875415548429056:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536108.049839:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536108.050024:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddc98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655880 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.050046:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:3.0:1788536108.050051:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536108.050113:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+22:2401:x1875415548429056:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 290us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.050129:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1788536108.051337:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548429312 00000100:00100000:2.0:1788536108.051350:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548429312 00000100:00100000:2.0:1788536108.051411:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1788536108.051422:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+22:15681:x1875415548429312:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:2.0:1788536108.051853:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+23:15681:x1875415548429312:12345-192.168.203.13@tcp:35:cat.0 Request processed in 432us (2321us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788536108.051861:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1788536108.104622:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536108.104781:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548429568 00000100:00100000:1.0:1788536108.104791:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548429568 00000100:00100000:1.0:1788536108.104856:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1788536108.104882:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+23:15687:x1875415548429568:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:1.0:1788536108.104906:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788536108.104928:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbddca6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655887 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.105042:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.105058:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655864 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.105067:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165586b expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.105076:0:17206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.105112:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165586b expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.105199:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165586b expref: 24 pid: 17204 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536108.105214:0:17206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875415569477376:192.168.203.13@tcp:104: 00010000:00010000:1.0:1788536108.105302:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655864 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.105311:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655864 expref: 24 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536108.105320:0:17206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004888de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875415569477504:192.168.203.13@tcp:104: 00000100:00100000:1.0:1788536108.105341:0:17206:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788536108.108395:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536108.108436:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.108514:0:20232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548429696 00000100:00100000:3.0:1788536108.108522:0:20232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548429696 00010000:00010000:3.0:1788536108.108569:0:20232:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165586b expref: 25 pid: 17204 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536108.108608:0:20232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548429824 00000100:00100000:3.0:1788536108.108611:0:20232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548429824 00010000:00010000:3.0:1788536108.108623:0:20232:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655864 expref: 26 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536108.108646:0:20232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1788536108.108661:0:20232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+26:2402:x1875415548429696:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536108.108685:0:20232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536108.108692:0:20232:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165586b expref: 26 pid: 17204 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.108704:0:20232:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165586b expref: 26 pid: 17204 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.108728:0:20232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:3.0:1788536108.108733:0:20232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.108742:0:20232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.108748:0:20232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536108.108806:0:20232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+26:2402:x1875415548429696:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 150us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.108813:0:20232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1788536108.108829:0:20232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1788536108.108835:0:20232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900584bae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+25:2402:x1875415548429824:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536108.108842:0:20232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536108.108847:0:20232:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655864 expref: 25 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.108856:0:20232:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655864 expref: 25 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.108883:0:20232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:3.0:1788536108.108887:0:20232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.108895:0:20232:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.108903:0:20232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.108918:0:20232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536108.108934:0:20232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900584bae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+25:2402:x1875415548429824:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 99us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.108939:0:20232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00010000:00010000:2.0:1788536108.109525:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddc60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165586b expref: 24 pid: 17204 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536108.109543:0:17206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900487ad1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875415569477376:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788536108.109568:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddc4b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655864 expref: 23 pid: 17206 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536108.109579:0:17206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004888de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875415569477504:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788536108.109600:0:17206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.109608:0:17206:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.109614:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536108.109631:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788536108.109794:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067e00/0xe79af2f39bbddca6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655887 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.109810:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff900488066c00/0xe79af2f39bbddcad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655887 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.109817:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536108.109820:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788536108.109822:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff900488066c00, rc 0) 00000100:00100000:2.0:1788536108.109874:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+23:15687:x1875415548429568:12345-192.168.203.13@tcp:101:dd.0 Request processed in 4998us (5250us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788536108.109882:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1788536108.113061:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.113176:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548429952 00000100:00100000:3.0:1788536108.113186:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548429952 00000100:00100000:3.0:1788536108.113244:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1788536108.113268:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+23:15687:x1875415548429952:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:3.0:1788536108.113292:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536108.113314:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddcbb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165588e expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.113347:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.113362:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.113372:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.113483:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddcbb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165588e expref: 25 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.113503:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165588e expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.113512:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:3.0:1788536108.113514:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788536108.113518:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51200, rc 0) 00000100:00100000:3.0:1788536108.113593:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+24:15687:x1875415548429952:12345-192.168.203.13@tcp:101:dd.0 Request processed in 327us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.113601:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1788536108.118739:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.118812:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548430208 00000100:00100000:3.0:1788536108.118821:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548430208 00000100:00100000:3.0:1788536108.118889:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1788536108.118916:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+24:15687:x1875415548430208:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:3.0:1788536108.119140:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.119201:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.119214:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788536108.119258:0:19995:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788536108.119280:0:19995:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 000000007246a52e reply state 000000001be69fbb transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.119292:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.119300:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:3.0:1788536108.119303:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788536108.119307:0:19995:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788536108.119607:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+27:15687:x1875415548430208:12345-192.168.203.13@tcp:36:dd.0 Request processed in 692us (875us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788536108.119614:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000020:00080000:3.0:1788536108.119619:0:19995:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788536108.122275:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.122366:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548430336 00000100:00100000:3.0:1788536108.122376:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548430336 00000100:00100000:3.0:1788536108.122481:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:3.0:1788536108.122492:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+27:15687:x1875415548430336:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:3.0:1788536108.122515:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536108.122536:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddcd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b1655895 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.122628:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddcd0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655895 expref: 28 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.122644:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddcd0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655895 expref: 28 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.122673:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:3.0:1788536108.122679:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788536108.122684:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51000, rc 0) 00000100:00100000:3.0:1788536108.122779:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+28:15687:x1875415548430336:12345-192.168.203.13@tcp:101:dd.0 Request processed in 287us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.122786:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00010000:00010000:0.0:1788536108.143372:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536108.146987:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.147489:0:20232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548430592 00000100:00100000:3.0:1788536108.147499:0:20232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548430592 00000100:00100000:3.0:1788536108.147648:0:20232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1788536108.147659:0:20232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+28:15687:x1875415548430592:12345-192.168.203.13@tcp:103:dd.0 00010000:00010000:3.0:1788536108.147686:0:20232:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536108.147717:0:20232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddcd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b1655895 expref: 28 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.147740:0:20232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:3.0:1788536108.147746:0:20232:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536108.147820:0:20232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+27:15687:x1875415548430592:12345-192.168.203.13@tcp:103:dd.0 Request processed in 163us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.147828:0:20232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1788536108.153513:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.153684:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548430720 00000100:00100000:2.0:1788536108.153694:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548430720 00000100:00100000:2.0:1788536108.154097:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1788536108.154110:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+27:15687:x1875415548430720:12345-192.168.203.13@tcp:58:dd.0 00010000:00010000:2.0:1788536108.154282:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.154300:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.154313:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788536108.155996:0:17206:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788536108.156228:0:17206:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788536108.156351:0:17206:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788536108.156584:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+27:15687:x1875415548430720:12345-192.168.203.13@tcp:58:dd.0 Request processed in 2471us (3076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.156602:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1788536108.159044:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.159172:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548430848 00000100:00100000:2.0:1788536108.159183:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548430848 00000100:00100000:2.0:1788536108.159236:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1788536108.159247:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+27:15687:x1875415548430848:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1788536108.159265:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536108.159286:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddcde lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b165589c expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.159339:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.159349:0:17205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddcde lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165589c expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.159367:0:17205:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.159379:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddcde lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165589c expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.159392:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536108.159395:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788536108.159398:0:17205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddcde lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165589c expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.159406:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058db3fe00, rc 0) 00000100:00100000:2.0:1788536108.159513:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+28:15687:x1875415548430848:12345-192.168.203.13@tcp:101:dd.0 Request processed in 267us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.159521:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000040:00080000:2.0:1788536108.396426:0:17238:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788536108.396435:0:17238:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788536108.396456:0:17238:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788536108.396465:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788536108.396608:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17238:1875415569477632:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788536108.396918:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b98c9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788536108.405257:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17238:1875415569477632:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788536108.409182:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.409483:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548430976 00000100:00100000:2.0:1788536108.409497:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548430976 00000100:00100000:2.0:1788536108.409571:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1788536108.409580:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+28:15688:x1875415548430976:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788536108.409612:0:19995:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788536108.409739:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+28:15688:x1875415548430976:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 160us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.409747:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1788536108.419702:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.419826:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548431104 00000100:00100000:2.0:1788536108.419836:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548431104 00000100:00100000:2.0:1788536108.419899:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1788536108.419909:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+28:15688:x1875415548431104:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788536108.419978:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.419996:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420022:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420106:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420115:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420123:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420340:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420351:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420358:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536108.420404:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788536108.420408:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788536108.420422:0:17205:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420433:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420439:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420457:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420463:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3fc00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536108.420467:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420474:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420486:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900583bb4700) 00010000:00010000:2.0:1788536108.420489:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536108.420494:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420500:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fc00/0xe79af2f39bbddce5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420514:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420521:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420527:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420532:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9005b998ec00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536108.420535:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420566:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420575:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff900583bb4e00) 00010000:00010000:2.0:1788536108.420577:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536108.420581:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420587:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ec00/0xe79af2f39bbddcec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420603:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420609:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420615:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420621:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9005b998fc00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536108.420624:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420630:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420637:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536108.420640:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536108.420643:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.420660:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998fc00/0xe79af2f39bbddcf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536108.420851:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+28:15688:x1875415548431104:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 941us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.420859:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1788536108.431348:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.431604:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548431360 00000100:00100000:2.0:1788536108.431615:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548431360 00000100:00100000:2.0:1788536108.431739:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1788536108.431751:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+28:15688:x1875415548431360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788536108.431772:0:19995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536108.431795:0:19995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e400/0xe79af2f39bbddcfa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16558a3 expref: -99 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.431898:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.431914:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.431925:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536108.431935:0:19995:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788536108.432006:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.432014:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.432037:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.432042:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9005b998e000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536108.432047:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.432055:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.432067:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536108.432070:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788536108.432075:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.432081:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.432121:0:19995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e400/0xe79af2f39bbddcfa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558a3 expref: 30 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.432132:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff900583bb4700) 00010000:00010000:2.0:1788536108.432135:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788536108.432139:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e400/0xe79af2f39bbddcfa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558a3 expref: 30 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.432178:0:19995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9005b998e400, rc 0) 00000100:00100000:2.0:1788536108.432231:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+29:15688:x1875415548431360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 483us (894us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788536108.432247:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1788536108.437967:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.438051:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548431488 00000100:00100000:3.0:1788536108.438062:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548431488 00000100:00100000:3.0:1788536108.438133:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:3.0:1788536108.438161:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+29:15688:x1875415548431488:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788536108.438205:0:17204:0:(mdt_handler.c:8016:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788536108.438324:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+29:15688:x1875415548431488:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 181us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.438333:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1788536108.441004:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536108.441199:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548431744 00000100:00100000:0.0:1788536108.441209:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548431744 00000100:00100000:0.0:1788536108.441271:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1788536108.441282:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+29:15688:x1875415548431744:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788536108.441303:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536108.441328:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddd0f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16558aa expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788536108.442068:0:17205:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:0.0:1788536108.442077:0:17205:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788536108.442097:0:17205:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788536108.442300:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbddd16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.442315:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbddd16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.442326:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbddd16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.442379:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620f200/0xe79af2f39bbddd0f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558aa expref: 32 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.442416:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbddd16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558aa expref: 31 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.442424:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9005b7af4300) 00010000:00010000:0.0:1788536108.442427:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788536108.442431:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e600, rc 0) 00000100:00100000:0.0:1788536108.442489:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+31:15688:x1875415548431744:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1208us (1495us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788536108.442496:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1788536108.450024:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.450110:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548432000 00000100:00100000:3.0:1788536108.450120:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548432000 00000100:00100000:3.0:1788536108.450199:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1788536108.450209:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+31:15688:x1875415548432000:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788536108.450277:0:17204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536108.450304:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059620e600/0xe79af2f39bbddd16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558aa expref: 31 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450324:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9005b7af4300) 00010000:00010000:3.0:1788536108.450337:0:17204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788536108.450361:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450376:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450386:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450402:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450422:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450430:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450478:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450485:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450491:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450496:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788536108.450501:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450508:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450516:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:3.0:1788536108.450518:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536108.450522:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450527:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd24 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450536:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450560:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450567:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450572:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:3.0:1788536108.450575:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450581:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450589:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6a7d8b2 (ffff900486936c00) 00010000:00010000:3.0:1788536108.450591:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788536108.450593:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.450599:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd2b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6a7d8b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536108.450860:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+30:15688:x1875415548432000:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 650us (844us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788536108.450868:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1788536108.462927:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.463050:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548432128 00000100:00100000:3.0:1788536108.463061:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548432128 00000100:00100000:3.0:1788536108.463122:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1788536108.463133:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+30:15688:x1875415548432128:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788536108.463173:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536108.463217:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbddd32 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16558b1 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.463257:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50000/0xe79af2f39bbddd39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.463272:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50000/0xe79af2f39bbddd39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.463285:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50000/0xe79af2f39bbddd39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.463392:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50a00/0xe79af2f39bbddd32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b1 expref: 32 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.463411:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50000/0xe79af2f39bbddd39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b1 expref: 31 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.463419:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:3.0:1788536108.463423:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788536108.463426:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af50000, rc 0) 00000100:00100000:3.0:1788536108.463478:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+31:15688:x1875415548432128:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 348us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.463485:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1788536108.470472:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.470563:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548432384 00000100:00100000:3.0:1788536108.470572:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548432384 00000100:00100000:3.0:1788536108.470730:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1788536108.470741:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+31:15688:x1875415548432384:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788536108.470830:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.470861:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.470874:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788536108.471040:0:17204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788536108.471050:0:17204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567274902446ns, next at 568274899841ns, rc = 0 00000004:00010000:3.0:1788536108.471095:0:17204:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000182a02eb reply state 000000008d972f6b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.471107:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.471114:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:3.0:1788536108.471117:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788536108.471121:0:17204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788536108.471243:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+33:15688:x1875415548432384:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 503us (779us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788536108.471250:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1788536108.473536:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.473745:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548432512 00000100:00100000:3.0:1788536108.473804:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548432512 00000100:00100000:3.0:1788536108.473912:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1788536108.473922:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+33:15688:x1875415548432512:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788536108.473946:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788536108.473966:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16558b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.474042:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b8 expref: 34 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.474056:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b8 expref: 34 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.474078:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:3.0:1788536108.474081:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788536108.474085:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90058af51800, rc 0) 00000100:00100000:2.0:1788536108.474279:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+34:15688:x1875415548432512:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 358us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.474287:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1788536108.476409:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.476447:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548432640 00000100:00100000:3.0:1788536108.476456:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548432640 00000100:00100000:3.0:1788536108.476511:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1788536108.476521:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2401:x1875415548432640:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788536108.476951:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:2401:x1875415548432640:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 430us (547us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788536108.476958:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1788536108.479426:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.479715:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548432896 00000100:00100000:3.0:1788536108.479724:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548432896 00000100:00100000:3.0:1788536108.479873:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1788536108.479883:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+34:15688:x1875415548432896:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788536108.480493:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+35:15688:x1875415548432896:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 609us (1074us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788536108.480502:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1788536108.485019:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536108.487225:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548433152 00000100:00100000:0.0:1788536108.487239:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548433152 00000100:00100000:1.0:1788536108.487446:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1788536108.487457:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+35:15688:x1875415548433152:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788536108.487577:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+35:15688:x1875415548433152:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 122us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536108.487585:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1788536108.492359:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.492516:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548433280 00000100:00100000:2.0:1788536108.492527:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548433280 00000100:00100000:2.0:1788536108.492602:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1788536108.492746:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+35:15688:x1875415548433280:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788536108.492813:0:19995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536108.492834:0:19995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e400/0xe79af2f39bbddd4e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16558bf expref: -99 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.492908:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.492922:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.493054:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788536108.493104:0:19995:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788536108.493124:0:19995:0:(mdt_handler.c:2551:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.493254:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e400/0xe79af2f39bbddd4e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558bf expref: 37 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.493296:0:19995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558bf expref: 36 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.493306:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:2.0:1788536108.493309:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788536108.493313:0:19995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9005b998e000, rc 0) 00000100:00100000:0.0:1788536108.494079:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+36:15688:x1875415548433280:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1451us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536108.494090:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:0.0:1788536108.501034:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.501218:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548433408 00000100:00100000:2.0:1788536108.501228:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548433408 00000100:00100000:2.0:1788536108.501320:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1788536108.501331:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:2402:x1875415548433408:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788536108.501349:0:18713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536108.501372:0:18713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16558c6 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788536108.501399:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ae52c, blocks: 0x0 00010000:00010000:2.0:1788536108.501418:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788536108.501423:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788536108.501433:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558c6 expref: 7 pid: 18713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.501454:0:18713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558c6 expref: 7 pid: 18713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.501467:0:18713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9005b998fc00, rc 0) 00000100:00100000:2.0:1788536108.501523:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:2402:x1875415548433408:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 195us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.501542:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1788536108.506142:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.506188:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548433664 00000100:00100000:3.0:1788536108.506216:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548433664 00000100:00100000:3.0:1788536108.506275:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1788536108.506286:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+36:15688:x1875415548433664:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788536108.506402:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+36:15688:x1875415548433664:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 117us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.506412:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1788536108.513269:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.513363:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548433792 00000100:00100000:2.0:1788536108.513373:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548433792 00000100:00100000:2.0:1788536108.513436:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:2.0:1788536108.513445:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+36:15688:x1875415548433792:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788536108.517722:0:17184:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788536108.517737:0:17184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788536108.517792:0:17184:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1788536108.517906:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.517921:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.517929:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.517935:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90059632f200 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788536108.517939:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.517946:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.517963:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90059d464c00) 00010000:00010000:1.0:1788536108.517966:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788536108.517971:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.517994:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90059632f200/0xe79af2f39bbddb95 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518017:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518024:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518029:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518035:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3f000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788536108.518038:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518044:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518053:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:1.0:1788536108.518056:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788536108.518059:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518064:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3f000/0xe79af2f39bbddb9c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.518067:0:3647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.518075:0:3647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518077:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.518082:0:3647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518083:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.518086:0:3647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:0.0:1788536108.518089:0:3647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518095:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518100:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3ec00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788536108.518103:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.518104:0:3647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518109:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.518113:0:3647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff900583bb4900) 00010000:00010000:1.0:1788536108.518115:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff900583bb4400) 00010000:00010000:0.0:1788536108.518115:0:3647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788536108.518117:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788536108.518118:0:3647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518120:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.518124:0:3647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddbe9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518126:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3ec00/0xe79af2f39bbddc44 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518140:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518179:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518186:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518190:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51400 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788536108.518193:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518209:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518219:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:1.0:1788536108.518221:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788536108.518224:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518229:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51400/0xe79af2f39bbddcc9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518241:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518247:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518252:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518256:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50e00 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:1.0:1788536108.518258:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518263:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518269:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:1.0:1788536108.518271:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788536108.518273:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.518286:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50e00/0xe79af2f39bbddd40 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536108.518305:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788536108.518322:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569477760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788536108.518402:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536108.518446:0:19157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569477760 00000100:00100000:0.0:1788536108.518453:0:19157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569477760 00000100:00100000:0.0:1788536108.518507:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788536108.518518:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569477760:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788536108.518640:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788536108.518651:0:19157:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788536108.518654:0:19157:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788536108.518666:0:19157:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788536108.518668:0:19157:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788536108 -> 1788536108 00002000:00010000:0.0:1788536108.518670:0:19157:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788536108.518711:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3660:x1875415569477760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (308us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788536108.518718:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1788536108.518818:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff900481cfe300/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788536108.518826:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569477760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788536108.518904:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+15:15688:x1875415548433792:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 5458us (5641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.518913:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1788536108.522824:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.522892:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548433920 00000100:00100000:2.0:1788536108.522902:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548433920 00000100:00100000:2.0:1788536108.522960:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788536108.522970:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:2401:x1875415548433920:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788536108.523073:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:2401:x1875415548433920:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 105us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.523081:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1788536108.526908:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536108.528743:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548434176 00000100:00100000:1.0:1788536108.528765:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548434176 00000100:00100000:1.0:1788536108.528844:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1788536108.528855:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+15:15688:x1875415548434176:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788536108.528914:0:17205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536108.528943:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998e000/0xe79af2f39bbddd55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558bf expref: 15 pid: 19995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.528961:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:1.0:1788536108.528966:0:17205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788536108.528994:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddd63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.529009:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddd63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.529019:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddd63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788536108.529182:0:17205:0:(mdt_handler.c:4533:mdt_save_lock()) ### save lock request 00000000ca03148c reply state 0000000028188ada transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddd63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.529196:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff900488067400/0xe79af2f39bbddd63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.529202:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:1.0:1788536108.529204:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788536108.529208:0:17205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788536108.529314:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+16:15688:x1875415548434176:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 460us (2414us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788536108.529319:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1788536108.534362:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536108.534578:0:19157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548434304 00000100:00100000:0.0:1788536108.534590:0:19157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548434304 00000100:00100000:0.0:1788536108.534709:0:19157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1788536108.534722:0:19157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005ba42fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:15688:x1875415548434304:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788536108.534765:0:19157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788536108.534785:0:19157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16558cd expref: -99 pid: 19157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.534817:0:19157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558c6 expref: 8 pid: 18713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.534827:0:19157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536108.534831:0:19157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788536108.534837:0:19157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 8 pid: 19157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.534875:0:19157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558c6 expref: 8 pid: 18713 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.534889:0:19157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558c6 expref: 8 pid: 18713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536108.534905:0:19157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19157:1875415569477888:192.168.203.13@tcp:104: 00000100:00100000:0.0:1788536108.534991:0:19157:0:(client.c:2716:ptlrpc_set_wait()) set ffff900485fb7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788536108.547296:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536108.548798:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548434432 00000100:00100000:1.0:1788536108.548811:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548434432 00010000:00010000:1.0:1788536108.548862:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558c6 expref: 9 pid: 18713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536108.548928:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1788536108.548940:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:2402:x1875415548434432:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788536108.548954:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788536108.548979:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558c6 expref: 9 pid: 18713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.548993:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558c6 expref: 9 pid: 18713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.549041:0:17191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536108.549046:0:17191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536108.549054:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 9 pid: 19157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.549064:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 9 pid: 19157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.549104:0:17191:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 9 pid: 19157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536108.549118:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17191:1875415569478016:192.168.203.13@tcp:105: 00000100:00100000:1.0:1788536108.549229:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff90048806af00 going to sleep for 11 seconds 00010000:00010000:2.0:1788536108.549450:0:19157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d3fefbd/0xe79af2f39bbddd5c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558c6 expref: 9 pid: 18713 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536108.549465:0:19157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19157:1875415569477888:192.168.203.13@tcp:104: 00010000:00010000:2.0:1788536108.549489:0:19157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 8 pid: 19157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.549508:0:19157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90059620e800, rc 0) 00000100:00100000:2.0:1788536108.549537:0:19157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005ba42fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+8:15688:x1875415548434304:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 14818us (15183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.549544:0:19157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1788536108.552912:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536108.552991:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548434560 00000100:00100000:0.0:1788536108.553000:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548434560 00000100:00100000:0.0:1788536108.553056:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1788536108.553065:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+8:2402:x1875415548434560:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788536108.553255:0:18711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788536108.553259:0:18711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788536108 00002000:00010000:0.0:1788536108.553262:0:18711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788536107 00002000:00010000:0.0:1788536108.553264:0:18711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788536108 -> 1788536108 00002000:00010000:0.0:1788536108.553266:0:18711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788536108.553330:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:2402:x1875415548434560:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 265us (429us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788536108.553339:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1788536108.553847:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17191:1875415569478016:192.168.203.13@tcp:105: 00010000:00010000:1.0:1788536108.553868:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788536108.553906:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+8:2402:x1875415548434432:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4968us (6622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536108.553915:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1788536108.557757:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.557843:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548434688 00000100:00100000:3.0:1788536108.557852:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548434688 00000100:00100000:3.0:1788536108.557910:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1788536108.557920:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+8:2402:x1875415548434688:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788536108.557960:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.557980:0:18712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 8 pid: 19157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.557988:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788536108.557993:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788536108.557998:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.558033:0:18712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 8 pid: 19157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.558047:0:18712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 8 pid: 19157 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536108.558079:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18712:1875415569478144:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788536108.558201:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788536108.561258:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18712:1875415569478144:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788536108.561288:0:18712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536108.562061:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.562205:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548434816 00000100:00100000:3.0:1788536108.562213:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548434816 00010000:00010000:3.0:1788536108.562251:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 9 pid: 19157 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536108.562292:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1788536108.562301:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+9:2402:x1875415548434816:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788536108.562316:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788536108.562337:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 9 pid: 19157 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.562350:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 9 pid: 19157 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.562374:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a611a76d/0xe79af2f39bbddd6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558cd expref: 9 pid: 19157 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.562410:0:17190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788536108.562415:0:17190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788536108.562421:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.562430:0:17190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.562463:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788536108.562530:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+8:2402:x1875415548434816:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 229us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.562537:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:0.0:1788536108.562604:0:18712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.562614:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.562633:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.562641:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.562650:0:18712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.562656:0:18712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50a00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:0.0:1788536108.562661:0:18712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.562683:0:18712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.562712:0:18712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.562720:0:18712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000059fd352/0xe79af2f39bbddd71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536108.562780:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+7:2402:x1875415548434688:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 4862us (5033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536108.562788:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:0.0:1788536108.570441:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.570527:0:19995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548435072 00000100:00100000:3.0:1788536108.570537:0:19995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548435072 00000100:00100000:3.0:1788536108.570610:0:19995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1788536108.570621:0:19995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+16:15688:x1875415548435072:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788536108.570711:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.570731:0:19995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165588e expref: 16 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.570741:0:19995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.570926:0:19995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165588e expref: 16 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.570953:0:19995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165588e expref: 16 pid: 17204 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536108.570968:0:19995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19995:1875415569478272:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788536108.571050:0:19995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536108.588624:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536108.588737:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548435200 00000100:00100000:0.0:1788536108.588748:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548435200 00010000:00010000:0.0:1788536108.588794:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165588e expref: 17 pid: 17204 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536108.588842:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1788536108.588853:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+17:2402:x1875415548435200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788536108.588871:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536108.588879:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165588e expref: 17 pid: 17204 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.588894:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165588e expref: 17 pid: 17204 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.588935:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:0.0:1788536108.588942:0:17189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddcde lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165589c expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.588952:0:17189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.588960:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.588968:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.588989:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536108.589048:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+17:2402:x1875415548435200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 196us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536108.589063:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00010000:00010000:3.0:1788536108.589237:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddcc2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b165588e expref: 16 pid: 17204 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536108.589255:0:19995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19995:1875415569478272:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788536108.589277:0:19995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.589286:0:19995:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.589291:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.589602:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.589616:0:19995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b8 expref: 16 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.589659:0:19995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.589726:0:19995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b8 expref: 16 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.589765:0:19995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b8 expref: 16 pid: 17206 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788536108.589780:0:19995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19995:1875415569478400:192.168.203.13@tcp:104: 00000100:00100000:3.0:1788536108.589855:0:19995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005c070ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788536108.602507:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.602618:0:19995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900481cffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19995:1875415569478400:192.168.203.13@tcp:104: 00010000:00010000:3.0:1788536108.602645:0:19995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536108.602730:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548435328 00000100:00100000:0.0:1788536108.602739:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548435328 00010000:00010000:0.0:1788536108.602775:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b8 expref: 17 pid: 17206 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536108.602812:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1788536108.602820:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+17:2401:x1875415548435328:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788536108.602834:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788536108.602840:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b8 expref: 17 pid: 17206 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.602873:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b8 expref: 17 pid: 17206 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.602894:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51800/0xe79af2f39bbddd47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558b8 expref: 17 pid: 17206 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.602910:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:0.0:1788536108.602915:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.602925:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.602932:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788536108.603211:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788536108.603269:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+16:2401:x1875415548435328:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 448us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788536108.603277:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00010000:00010000:3.0:1788536108.609811:0:19995:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.609831:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788536108.610528:0:19995:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788536108.610660:0:19995:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788536108.610872:0:19995:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788536108.610979:0:19995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488087b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19995:1875415569478528:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788536108.611044:0:19995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788536108.611334:0:19995:0:(client.c:2716:ptlrpc_set_wait()) set ffff90059dd11e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788536108.611426:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569478528 00000100:00100000:3.0:1788536108.611434:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569478528 00000100:00100000:3.0:1788536108.611485:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788536108.611494:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19995:x1875415569478528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788536108.611599:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19995:x1875415569478528:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788536108.611607:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788536108.611707:0:19995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488087b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19995:1875415569478528:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788536108.611876:0:19995:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788536108.611924:0:19995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19995:1875415569478656:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788536108.611955:0:19995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536108.611986:0:19995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b98c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788536108.612362:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569478656 00000100:00100000:3.0:1788536108.612369:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569478656 00000100:00100000:3.0:1788536108.612408:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788536108.612416:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19995:x1875415569478656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788536108.612541:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:19995:x1875415569478656:12345-0@lo:1000:mdt00_003.0 Request processed in 126us (585us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788536108.612560:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788536108.613383:0:19995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19995:1875415569478656:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788536108.613437:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613448:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613456:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613462:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536108.613467:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613492:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613508:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:2.0:1788536108.613511:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788536108.613516:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613523:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51000/0xe79af2f39bbddd7f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613572:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613579:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613586:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613591:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058db3e600 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536108.613594:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613600:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613608:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536108.613611:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788536108.613618:0:19995:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddcde lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165589c expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613640:0:19995:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddcde lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165589c expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613650:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddcde lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165589c expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.613978:0:19995:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3fe00/0xe79af2f39bbddcde lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b165589c expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536108.613994:0:19995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879ca680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19995:1875415569478784:192.168.203.13@tcp:105: 00000100:00100000:2.0:1788536108.614531:0:19995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9005b98c90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788536108.623055:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1788536108.623582:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548435456 00000100:00100000:0.0:1788536108.623592:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548435456 00000100:00100000:0.0:1788536108.623918:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1788536108.623929:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059e5d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+20:15687:x1875415548435456:12345-192.168.203.13@tcp:49:dd.0 00000100:00100000:2.0:1788536108.623966:0:19995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879ca680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19995:1875415569478784:192.168.203.13@tcp:105: 00010000:00010000:2.0:1788536108.623993:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624003:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058db3e600/0xe79af2f39bbddcd7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624036:0:19995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624049:0:19995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624060:0:19995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624069:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536108.624080:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059e5d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+20:15687:x1875415548435456:12345-192.168.203.13@tcp:49:dd.0 Request processed in 153us (1034us total) trans 0 rc 0/0 00010000:00010000:2.0:1788536108.624081:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788536108.624087:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:2.0:1788536108.624088:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624093:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9005b998f000 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536108.624097:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624104:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624115:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536108.624118:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788536108.624122:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624127:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f000/0xe79af2f39bbddd86 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624137:0:19995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624143:0:19995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624176:0:19995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624180:0:19995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af50800 already unused, calling callback (ffffffffc181c4f0) 00010000:00010000:2.0:1788536108.624188:0:19995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624194:0:19995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624203:0:19995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536108.624205:0:19995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788536108.624208:0:19995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.624212:0:19995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af50800/0xe79af2f39bbddd78 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19995 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536108.624342:0:19995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+19:15688:x1875415548435072:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 53722us (53910us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788536108.624351:0:19995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000020:00080000:2.0:1788536108.624355:0:19995:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788536108.624516:0:17238:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788536108.624520:0:17238:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788536108.624535:0:17238:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788536108.624557:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788536108.627371:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1788536108.627937:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548435584 00000100:00100000:2.0:1788536108.627948:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548435584 00000100:00100000:2.0:1788536108.628007:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1788536108.628017:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+19:15687:x1875415548435584:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1788536108.628036:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788536108.628055:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ea00/0xe79af2f39bbddd8d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7eba544b16558d4 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.628086:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f600/0xe79af2f39bbddd94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.628100:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f600/0xe79af2f39bbddd94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.628127:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f600/0xe79af2f39bbddd94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.628251:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998ea00/0xe79af2f39bbddd8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558d4 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.628269:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9005b998f600/0xe79af2f39bbddd94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0xd7eba544b16558d4 expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.628277:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff900583bb4f00) 00010000:00010000:2.0:1788536108.628280:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788536108.628283:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9005b998f600, rc 0) 00000100:00100000:2.0:1788536108.628348:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+20:15687:x1875415548435584:12345-192.168.203.13@tcp:101:dd.0 Request processed in 332us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536108.628355:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1788536108.634688:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.634765:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548435840 00000100:00100000:3.0:1788536108.634775:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548435840 00000100:00100000:3.0:1788536108.634829:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1788536108.634841:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004879ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+20:15688:x1875415548435840:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788536108.635116:0:17208:0:(mdd_object.c:4338:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788536108.635195:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788536108.635233:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.635250:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.635264:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.635274:0:17208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.635282:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.635290:0:17208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788536108.635309:0:17208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788536108.635398:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004879ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+22:15688:x1875415548435840:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 558us (722us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788536108.635424:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000020:00080000:3.0:1788536108.635429:0:17208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788536108.635511:0:19531:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788536108.635519:0:19531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.635526:0:19531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90058af51200 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536108.635530:0:19531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.635537:0:19531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.635562:0:19531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff900486936800) 00010000:00010000:1.0:1788536108.635566:0:19531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788536108.635572:0:19531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.635579:0:19531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90058af51200/0xe79af2f39bbddd9b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.635592:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536108.635594:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788536108.635596:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788536108.830049:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1788536108.830120:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1788536108.830415:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548436096 00000100:00100000:1.0:1788536108.830424:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548436096 00000100:00100000:1.0:1788536108.830494:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415548435968 00000100:00100000:1.0:1788536108.830498:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415548435968 00000100:00100000:1.0:1788536108.830520:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788536108.830531:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900481cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+8:2400:x1875415548436096:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:1.0:1788536108.830590:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ae52c, atime: 0x6a9ae52b, ctime: 0x6a9ae52c, blocks: 0x0 00010000:00010000:1.0:1788536108.830611:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.830628:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788536108.830632:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536108.830638:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.830655:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788536108.926344:0:19525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788536108.926364:0:19525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788536108.930581:0:18717:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1788536108.930591:0:18717:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788536108 -> 1788536109 00002000:00010000:1.0:1788536108.930594:0:18717:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788536108 -> 1788536109 00002000:00010000:1.0:1788536108.930597:0:18717:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1788536108.930614:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.930628:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.930637:0:18717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.930644:0:18717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067a00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:1.0:1788536108.930648:0:18717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.930888:0:18717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.930906:0:18717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.930914:0:18717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f07de76/0xe79af2f39bbddda2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788536108.931070:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900481cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+6:2400:x1875415548436096:12345-192.168.203.13@tcp:4:dd.0 Request processed in 100527us (101019us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788536108.931081:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1788536108.931113:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1788536108.931126:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2400:x1875415548435968:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:1.0:1788536108.931224:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a9ae52d, atime: 0x6a9ae52b, ctime: 0x6a9ae52d, blocks: 0x1a68 00010000:00010000:1.0:1788536108.931232:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.931243:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788536108.931247:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788536108.931254:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788536108.931267:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788536108.990807:0:19525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788536108.990972:0:18717:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788536108.990993:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.991006:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.991014:0:18717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.991021:0:18717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff900488067e00 already unused, calling callback (ffffffffc0c0d530) 00010000:00010000:2.0:1788536108.991039:0:18717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.991050:0:18717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.991785:0:18717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788536108.991800:0:18717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb19facf/0xe79af2f39bbddda9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788536108.991913:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b39ac8ea-251b-4f7c-a7f5-80db5502e4fc+5:2400:x1875415548435968:12345-192.168.203.13@tcp:4:dd.0 Request processed in 60787us (161789us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788536108.991931:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00010000:00010000:1.0:1788536109.166916:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788536109.998051:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569478912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788536109.998125:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536109.998205:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569478912 00000100:00100000:1.0:1788536109.998212:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569478912 00000100:00100000:1.0:1788536109.998267:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788536109.998277:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9004883c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569478912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788536109.998305:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788536109.998348:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9004883c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569478912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536109.998355:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788536109.998374:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788536109.998408:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569478912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788536110.188447:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788536110.508551:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788536110.508579:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004883c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569479040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788536110.508657:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536110.508819:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569479040 00000100:00100000:1.0:1788536110.508829:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569479040 00000100:00100000:1.0:1788536110.508892:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788536110.508902:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569479040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788536110.508931:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788536110.508979:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875415569479040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536110.508986:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788536110.509026:0:3662:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788536110.509032:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff900481cfe300, transno 8589934596 00000004:00080000:1.0:1788536110.509045:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788536110.509078:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004883c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3662:1875415569479040:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788536110.509280:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788536110.509832:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569479168:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.509878:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.509911:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569479680:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.509937:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.509955:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569480192:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.509977:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.509997:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788536110.510003:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569479296:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510023:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.510040:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569479808:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510060:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.510088:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569480320:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510109:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.510138:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569479168 00000100:00100000:2.0:1788536110.510143:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569479168 00000100:00100000:2.0:1788536110.510206:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788536110.510213:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9005b7c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:3660:x1875415569479168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510254:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9005b7c24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25821a76-2177-4c11-bd6b-eb660028a815+24:3660:x1875415569479168:12345-0@lo:400:kworker.0 Request processed in 41us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.510261:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788536110.510291:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569479680 00000100:00100000:2.0:1788536110.510295:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569479680 00000100:00100000:2.0:1788536110.510317:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569479296 00000100:00100000:2.0:1788536110.510324:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569479296 00000100:00100000:2.0:1788536110.510338:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788536110.510344:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569479680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510377:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569479680:12345-0@lo:400:kworker.0 Request processed in 33us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.510383:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788536110.510395:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788536110.510401:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569479296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510426:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875415569479296:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.510432:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788536110.510449:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569480192 00000100:00100000:2.0:1788536110.510452:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569480192 00000100:00100000:2.0:1788536110.510483:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569480320 00000100:00100000:2.0:1788536110.510486:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569480320 00000100:00100000:2.0:1788536110.510505:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788536110.510519:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569480192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510559:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fbc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875415569480192:12345-0@lo:400:kworker.0 Request processed in 41us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.510566:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788536110.510577:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788536110.510582:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569480320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510603:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875415569480320:12345-0@lo:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.510609:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788536110.510642:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569479552:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510665:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.510683:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569480064:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510703:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.510717:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569480576:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510737:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.510752:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788536110.510757:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569479424:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510775:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.510791:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9004879c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569479936:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510808:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.510824:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90059fbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569480448:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510843:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788536110.510863:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569479808 00000100:00100000:2.0:1788536110.510866:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569479808 00000100:00100000:2.0:1788536110.510889:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569479424 00000100:00100000:2.0:1788536110.510896:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569479424 00000100:00100000:2.0:1788536110.510908:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569479936 00000100:00100000:2.0:1788536110.510910:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569479936 00000100:00100000:2.0:1788536110.510923:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788536110.510928:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569479808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.510954:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875415569479808:12345-0@lo:400:kworker.0 Request processed in 26us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.510960:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788536110.510970:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788536110.510975:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569479424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511002:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875415569479424:12345-0@lo:400:kworker.0 Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.511008:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788536110.511018:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788536110.511024:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569479936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511048:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875415569479936:12345-0@lo:400:kworker.0 Request processed in 25us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.511054:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788536110.511075:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569479552 00000100:00100000:2.0:1788536110.511078:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569479552 00000100:00100000:2.0:1788536110.511093:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569480064 00000100:00100000:2.0:1788536110.511095:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569480064 00000100:00100000:2.0:1788536110.511105:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569480576 00000100:00100000:2.0:1788536110.511108:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569480576 00000100:00100000:2.0:1788536110.511118:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569480448 00000100:00100000:2.0:1788536110.511121:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569480448 00000100:00100000:2.0:1788536110.511132:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788536110.511137:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569479552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511192:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875415569479552:12345-0@lo:400:kworker.0 Request processed in 55us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.511198:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788536110.511208:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788536110.511213:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569480064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511231:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875415569480064:12345-0@lo:400:kworker.0 Request processed in 18us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.511236:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788536110.511244:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788536110.511249:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569480576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511266:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875415569480576:12345-0@lo:400:kworker.0 Request processed in 18us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.511272:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788536110.511279:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788536110.511284:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90059fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569480448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511302:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90059fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875415569480448:12345-0@lo:400:kworker.0 Request processed in 18us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788536110.511307:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788536110.511327:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788536110.511330:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788536110.511334:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788536110.511336:0:17199:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788536110.511366:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3663:1875415569479424:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511379:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3663:1875415569479936:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511388:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3663:1875415569480448:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511407:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875415569479552:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511416:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875415569480064:0@lo:400:kworker.0 00010000:00080000:2.0:1788536110.511428:0:3663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059fbc6a00 x1875415569480576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536110.511438:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059fbc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3663:1875415569480576:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511482:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3660:1875415569479296:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511491:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569479808:0@lo:400:kworker.0 00010000:00080000:2.0:1788536110.511502:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90059faf3b80 x1875415569480320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788536126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788536110.511509:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3660:1875415569480320:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511518:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25821a76-2177-4c11-bd6b-eb660028a815:3660:1875415569479168:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511526:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9004879ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3660:1875415569479680:0@lo:400:kworker.0 00000100:00100000:2.0:1788536110.511551:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90059faf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3660:1875415569480192:0@lo:400:kworker.0 00000100:00100000:0.0:1788536110.516618:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788536110.516640:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff900488086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569480704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788536110.517273:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788536110.517403:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875415569480704 00000100:00100000:1.0:1788536110.517412:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875415569480704 00000100:00100000:1.0:1788536110.517460:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788536110.517469:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff900488085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569480704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788536110.517491:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788536110.517552:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff900488085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875415569480704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788536110.517557:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788536110.517604:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff900488086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3661:1875415569480704:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1788536110.702703:0:17238:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788536110.702712:0:17238:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788536110.702731:0:17238:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788536110.702742:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:3.0:1788536110.785314:0:20382:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788536111.215003:0:19531:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788536112.240083:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41988 lines, 41988 kept, 0 dropped, 0 bad.